Beta. Content is under active construction and has not been peer-reviewed. Report errors on
GitHub
.
Disclaimer
Theorem
Path
Curriculum
Paths
Demos
Diagnostic
Search
Quiz Hub
/
Efficient Transformers Survey
Efficient Transformers Survey
3 questions
Difficulty 5-7
View topic
Intermediate
0 / 3
2 intermediate
1 advanced
Adapts to your performance
1 / 3
intermediate (5/10)
state theorem
Tay et al. 'Efficient Transformers: A Survey' (2022) groups methods into several categories. Which categorization is standard?
Hide and think first
A.
Neural vs. analytical, with neural methods needing training and analytical methods not
B.
Exact vs. approximate, with all efficient methods being approximate by definition
C.
Sparse patterns, low-rank, kernel methods, recurrent-style, downsampling, IO-aware — each addresses a different aspect of the
O
(
n
2
d
)
cost
D.
Slow, medium, fast — ranked purely by measured wall-clock speed
Submit Answer