Backpropagation with Reconstruction

Differentiable architecture search (DARTS) is successfully applied in many vision tasks. However, directly using DARTS for Trans- formers is memory-intensive, which renders the search process infeasible. To this end, we …...