👨⏰🐍 [Python] 시간복잡도 2
시간 복잡도 줄이기
Posts by Tag
- Python 28
- Codeing Test 23
- Algorithm 23
- Baekjoon 18
- String Handle 15
- Pytorch 14
- Natural Language Process 9
- Self-Attention 8
- Linear Algebra 6
- Transformer 5
- BERT 5
- Error Handling 4
- CUDA 4
- CS 4
- Graph 3
- Optimization Theory 3
- Calculus 3
- Dimension Mismatch 2
- DeBERTa 2
- Encoder 2
- Function 2
- Argument 2
- mutable 2
- BFS 2
- SVD 2
- PCA 2
- ELECTRA 2
- Linear-Attention 2
- Norm 1
- Pooling 1
- Inner Product 1
- Projection Matrix 1
- 내적 1
- 정사영 1
- Logsoftmax 1
- NaN 1
- DataLoader 1
- collate_fn 1
- Dynamic Padding 1
- Padding 1
- nn.Embedding 1
- linear independent 1
- span 1
- sub-space 1
- vector space 1
- rank 1
- column space 1
- null space 1
- basis 1
- Computer Vision 1
- Vision Transformer 1
- ViT 1
- Image Classification 1
- RoBERTa 1
- Disentangled-Attention 1
- Relative Position Embedding 1
- EMD 1
- Seq2Seq 1
- Decoder 1
- Object 1
- Attribute 1
- Assertion 1
- ML 1
- Deep Learning 1
- array 1
- list 1
- tuple 1
- list comprehension 1
- Dijkstra 1
- Floyd-Warshall 1
- MST 1
- Kruskal 1
- Prim 1
- collections 1
- Union-Find 1
- Convex Optimization 1
- Newton-Raphson 1
- Eigen Decomposition 1
- Eigen Vector 1
- Eigen Value 1
- Partial Derivative 1
- Total Derivative 1
- loss function 1
- Gradient 1
- Gradient Descent 1
- Machine Learning 1
- Singular Value Decomposition 1
- Singular Vector 1
- Singular Value 1
- Product Rule 1
- Quotient Rule 1
- Tensor 1
- DFS 1
- BackTracking 1
- DeBERTa-V3 1
- Weight Sharing 1
- GDES 1
- DistilBERT 1
- GAN 1
- Roformer 1
- Transformation Matrix 1
- Complex Space 1
- SpanBERT 1
- Kernel Trick 1
- Time Complexity 1
- LoRA 1
- Low-Rank Adaptation 1
- Fine-Tune 1
- Optimization 1
- Huggingface 1
- PEFT 1
Python
👨⏰🐍 [Python] 시간복잡도 1
시간 복잡도에 대한 이해
👩💻🎄 [baekjoon] 1987번: 알파벳
백준 1987번: 알파벳
🗂️ Graph Theory 4: Union-Find (Disjoint Set)
Union-Find Algorithm with Disjoint Set
✏️ Summary of Useful Library for Coding Test
코딩 테스트 풀이에 자주 사용되는 파이썬 내장 라이브러리 사용법 정리
🗂️ Graph Theory 5: MST with Kruskal & Prim
MST with Kruskal & Prim Algorithm
🗂️ Graph Theory 3: Floyd-Warshall
Floyd-Warshall Algorithm with DP Tabulation
🗂️ Graph Theory 2: Dijkstra
Dijkstra Algorithm with Priority Queue
👩💻🎄 [baekjoon] 16920번: 확장게임
백준 16920번: 확장게임
👩💻🎄 [baekjoon] 15558번: 점프 게임
백준 15558번: 점프 게임 풀이
👨💻🐍 [Python] Function Argument
함수 인자 전달 메커니즘에 대한 이해
👨💻🐍 [Python] List & Tuple
List, Tuple에 대한 이해
👩💻🔭 [baekjoon] 1962번: 그림
백준 1962번 그림 풀이
👩💻🔠 [baekjoon] 5052번: 전화번호 목록
백준 5052번 전화번호 목록
👩💻💵 [baekjoon] 1789번: 수들의 합
백준 1789번 수들의 합 풀이
👩💻🔠 [baekjoon] 17609번: 회문
백준 17609번 회문 풀이
👩💻💵 [baekjoon] 11501번: 주식
백준 11501번 주식 풀이
👩💻🔠 [baekjoon] 1969번: DNA
백준 1969번 괄호 풀이
👩💻🔠 [baekjoon] 12891번: DNA 비밀번호
백준 12891번 DNA 비밀번호 풀이
👩💻🔠 [baekjoon] 5430번: AC
백준 5430번 괄호 풀이
👩💻🔠 [baekjoon] 1764번: 듣보잡
백준 1764번 괄호 풀이
👩💻🔠 [baekjoon] 14425번: 문자열 집합
백준 14425번 괄호 풀이
👩💻🔠 [baekjoon] 1254번: 팰린드롬 만들기
백준 1254번 괄호 풀이
👩💻🔠 [baekjoon] 9012번: 괄호
백준 9012번 괄호 풀이
👩💻🔠 [baekjoon] 1316번: 그룹 단어 체커
백준 1316 그룹 단어 체커 풀이
👩💻🔠 [baekjoon] 1427번: 소트인사이드
백준 1427번 문자열 풀이
👩💻🔠 [baekjoon] 1120번: 문자열
백준 1120번 문자열 풀이
👨💻🐍 [Python] Object Attribute & Assertion Function
getattr, setattr, delattr, hasattr, Assertion 사용방법
Codeing Test
👩💻🎄 [baekjoon] 1987번: 알파벳
백준 1987번: 알파벳
🗂️ Graph Theory 4: Union-Find (Disjoint Set)
Union-Find Algorithm with Disjoint Set
✏️ Summary of Useful Library for Coding Test
코딩 테스트 풀이에 자주 사용되는 파이썬 내장 라이브러리 사용법 정리
🗂️ Graph Theory 5: MST with Kruskal & Prim
MST with Kruskal & Prim Algorithm
🗂️ Graph Theory 3: Floyd-Warshall
Floyd-Warshall Algorithm with DP Tabulation
🗂️ Graph Theory 2: Dijkstra
Dijkstra Algorithm with Priority Queue
👩💻🎄 [baekjoon] 16920번: 확장게임
백준 16920번: 확장게임
👩💻🎄 [baekjoon] 15558번: 점프 게임
백준 15558번: 점프 게임 풀이
👩💻🔭 [baekjoon] 1962번: 그림
백준 1962번 그림 풀이
👩💻🔠 [baekjoon] 5052번: 전화번호 목록
백준 5052번 전화번호 목록
👩💻💵 [baekjoon] 1789번: 수들의 합
백준 1789번 수들의 합 풀이
👩💻🔠 [baekjoon] 17609번: 회문
백준 17609번 회문 풀이
👩💻💵 [baekjoon] 11501번: 주식
백준 11501번 주식 풀이
👩💻🔠 [baekjoon] 1969번: DNA
백준 1969번 괄호 풀이
👩💻🔠 [baekjoon] 12891번: DNA 비밀번호
백준 12891번 DNA 비밀번호 풀이
👩💻🔠 [baekjoon] 5430번: AC
백준 5430번 괄호 풀이
👩💻🔠 [baekjoon] 1764번: 듣보잡
백준 1764번 괄호 풀이
👩💻🔠 [baekjoon] 14425번: 문자열 집합
백준 14425번 괄호 풀이
👩💻🔠 [baekjoon] 1254번: 팰린드롬 만들기
백준 1254번 괄호 풀이
👩💻🔠 [baekjoon] 9012번: 괄호
백준 9012번 괄호 풀이
👩💻🔠 [baekjoon] 1316번: 그룹 단어 체커
백준 1316 그룹 단어 체커 풀이
👩💻🔠 [baekjoon] 1427번: 소트인사이드
백준 1427번 문자열 풀이
👩💻🔠 [baekjoon] 1120번: 문자열
백준 1120번 문자열 풀이
Algorithm
👩💻🎄 [baekjoon] 1987번: 알파벳
백준 1987번: 알파벳
🗂️ Graph Theory 4: Union-Find (Disjoint Set)
Union-Find Algorithm with Disjoint Set
✏️ Summary of Useful Library for Coding Test
코딩 테스트 풀이에 자주 사용되는 파이썬 내장 라이브러리 사용법 정리
🗂️ Graph Theory 5: MST with Kruskal & Prim
MST with Kruskal & Prim Algorithm
🗂️ Graph Theory 3: Floyd-Warshall
Floyd-Warshall Algorithm with DP Tabulation
🗂️ Graph Theory 2: Dijkstra
Dijkstra Algorithm with Priority Queue
👩💻🎄 [baekjoon] 16920번: 확장게임
백준 16920번: 확장게임
👩💻🎄 [baekjoon] 15558번: 점프 게임
백준 15558번: 점프 게임 풀이
👩💻🔭 [baekjoon] 1962번: 그림
백준 1962번 그림 풀이
👩💻🔠 [baekjoon] 5052번: 전화번호 목록
백준 5052번 전화번호 목록
👩💻💵 [baekjoon] 1789번: 수들의 합
백준 1789번 수들의 합 풀이
👩💻🔠 [baekjoon] 17609번: 회문
백준 17609번 회문 풀이
👩💻💵 [baekjoon] 11501번: 주식
백준 11501번 주식 풀이
👩💻🔠 [baekjoon] 1969번: DNA
백준 1969번 괄호 풀이
👩💻🔠 [baekjoon] 12891번: DNA 비밀번호
백준 12891번 DNA 비밀번호 풀이
👩💻🔠 [baekjoon] 5430번: AC
백준 5430번 괄호 풀이
👩💻🔠 [baekjoon] 1764번: 듣보잡
백준 1764번 괄호 풀이
👩💻🔠 [baekjoon] 14425번: 문자열 집합
백준 14425번 괄호 풀이
👩💻🔠 [baekjoon] 1254번: 팰린드롬 만들기
백준 1254번 괄호 풀이
👩💻🔠 [baekjoon] 9012번: 괄호
백준 9012번 괄호 풀이
👩💻🔠 [baekjoon] 1316번: 그룹 단어 체커
백준 1316 그룹 단어 체커 풀이
👩💻🔠 [baekjoon] 1427번: 소트인사이드
백준 1427번 문자열 풀이
👩💻🔠 [baekjoon] 1120번: 문자열
백준 1120번 문자열 풀이
Baekjoon
👩💻🎄 [baekjoon] 1987번: 알파벳
백준 1987번: 알파벳
👩💻🎄 [baekjoon] 16920번: 확장게임
백준 16920번: 확장게임
👩💻🎄 [baekjoon] 15558번: 점프 게임
백준 15558번: 점프 게임 풀이
👩💻🔭 [baekjoon] 1962번: 그림
백준 1962번 그림 풀이
👩💻🔠 [baekjoon] 5052번: 전화번호 목록
백준 5052번 전화번호 목록
👩💻💵 [baekjoon] 1789번: 수들의 합
백준 1789번 수들의 합 풀이
👩💻🔠 [baekjoon] 17609번: 회문
백준 17609번 회문 풀이
👩💻💵 [baekjoon] 11501번: 주식
백준 11501번 주식 풀이
👩💻🔠 [baekjoon] 1969번: DNA
백준 1969번 괄호 풀이
👩💻🔠 [baekjoon] 12891번: DNA 비밀번호
백준 12891번 DNA 비밀번호 풀이
👩💻🔠 [baekjoon] 5430번: AC
백준 5430번 괄호 풀이
👩💻🔠 [baekjoon] 1764번: 듣보잡
백준 1764번 괄호 풀이
👩💻🔠 [baekjoon] 14425번: 문자열 집합
백준 14425번 괄호 풀이
👩💻🔠 [baekjoon] 1254번: 팰린드롬 만들기
백준 1254번 괄호 풀이
👩💻🔠 [baekjoon] 9012번: 괄호
백준 9012번 괄호 풀이
👩💻🔠 [baekjoon] 1316번: 그룹 단어 체커
백준 1316 그룹 단어 체커 풀이
👩💻🔠 [baekjoon] 1427번: 소트인사이드
백준 1427번 문자열 풀이
👩💻🔠 [baekjoon] 1120번: 문자열
백준 1120번 문자열 풀이
String Handle
👩💻🔭 [baekjoon] 1962번: 그림
백준 1962번 그림 풀이
👩💻🔠 [baekjoon] 5052번: 전화번호 목록
백준 5052번 전화번호 목록
👩💻💵 [baekjoon] 1789번: 수들의 합
백준 1789번 수들의 합 풀이
👩💻🔠 [baekjoon] 17609번: 회문
백준 17609번 회문 풀이
👩💻💵 [baekjoon] 11501번: 주식
백준 11501번 주식 풀이
👩💻🔠 [baekjoon] 1969번: DNA
백준 1969번 괄호 풀이
👩💻🔠 [baekjoon] 12891번: DNA 비밀번호
백준 12891번 DNA 비밀번호 풀이
👩💻🔠 [baekjoon] 5430번: AC
백준 5430번 괄호 풀이
👩💻🔠 [baekjoon] 1764번: 듣보잡
백준 1764번 괄호 풀이
👩💻🔠 [baekjoon] 14425번: 문자열 집합
백준 14425번 괄호 풀이
👩💻🔠 [baekjoon] 1254번: 팰린드롬 만들기
백준 1254번 괄호 풀이
👩💻🔠 [baekjoon] 9012번: 괄호
백준 9012번 괄호 풀이
👩💻🔠 [baekjoon] 1316번: 그룹 단어 체커
백준 1316 그룹 단어 체커 풀이
👩💻🔠 [baekjoon] 1427번: 소트인사이드
백준 1427번 문자열 풀이
👩💻🔠 [baekjoon] 1120번: 문자열
백준 1120번 문자열 풀이
Pytorch
🔪 [LoRA] Low-Rank Adaptation of Large Language Models
LoRA Official Paper Review with Pytorch Implementation
🌆 [Linear Attention] Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention
Linear Attention Official Paper Review with Pytorch Implementation
🗂️[SpanBERT] SpanBERT: Improving Pre-training by Representing and Predicting Spans
SpanBERT Official Paper Review with Pytorch Implementation
🎡 [Roformer] RoFormer: Enhanced Transformer with Rotary Position Embedding
Roformer Official Paper Review with Pytorch Implementation
👮 [ELECTRA] Pre-training Text Encoders as Discriminators Rather Than Generators
ELECTRA Official Paper Review with Pytorch Implementation
🧑🏫 [DistilBERT] DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter
DistilBERT Official Paper Review with Pytorch Implementation
🪢 [DeBERTa-V3] DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharing
DeBERTa-V3 Official Paper Review with Pytorch Implementation
🔥 Pytorch Tensor Indexing 자주 사용하는 메서드 모음집
파이토치에서 자주 사용하는 텐서 인덱싱 관련 메서드 모음
🎲 RuntimeError: CUDA error: CUBLAS_STATUS_ALLOC_FAILED when calling cublasCreate(hand≤)
Pytorch Error: Mis-match between pre-defined dimension and input dimension
🎲 RuntimeError: CUDA error: device-side assert triggered
Pytorch Error: Mis-match between pre-defined dimension and input dimension
🪢 assert len(optimizer_state[“found_inf_per_device”]) > 0, “No inf checks were recorded for this optimizer.” AssertionError: No inf checks were recorded for this optimizer.
Pytorch Error: Optimizer can’t backward loss
🚚 RuntimeError: stack expects each tensor to be equal size, but got [32] at entry 0 and [24] at entry 1
Pytorch Error: Dataloader get non-equal size of tensor
🖥️ RuntimeError: Attempting to deserialize object on CUDA device 2 but torch.cuda.device_count() is 1. Please use torch.load with map_location to map your storages to an existing device
Pytorch Error: Wrong CUDA Device Number
🤔 RuntimeError: Function ‘LogSoftmaxBackward0’ returned nan values in its 0th output
Pytorch Error: Backward NaN values
Natural Language Process
🔪 [LoRA] Low-Rank Adaptation of Large Language Models
LoRA Official Paper Review with Pytorch Implementation
🌆 [Linear Attention] Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention
Linear Attention Official Paper Review with Pytorch Implementation
🗂️[SpanBERT] SpanBERT: Improving Pre-training by Representing and Predicting Spans
SpanBERT Official Paper Review with Pytorch Implementation
🎡 [Roformer] RoFormer: Enhanced Transformer with Rotary Position Embedding
Roformer Official Paper Review with Pytorch Implementation
👮 [ELECTRA] Pre-training Text Encoders as Discriminators Rather Than Generators
ELECTRA Official Paper Review with Pytorch Implementation
🧑🏫 [DistilBERT] DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter
DistilBERT Official Paper Review with Pytorch Implementation
🪢 [DeBERTa-V3] DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharing
DeBERTa-V3 Official Paper Review with Pytorch Implementation
🤖 [Transformer] Attention Is All You Need
Transformer Official Paper Review with Pytorch Implementation
🪢 [DeBERTa] DeBERTa: Decoding-Enhanced BERT with Disentangled-Attention
Transformer Official Paper Review with Pytorch Implementation
Self-Attention
🌆 [Linear Attention] Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention
Linear Attention Official Paper Review with Pytorch Implementation
🗂️[SpanBERT] SpanBERT: Improving Pre-training by Representing and Predicting Spans
SpanBERT Official Paper Review with Pytorch Implementation
🎡 [Roformer] RoFormer: Enhanced Transformer with Rotary Position Embedding
Roformer Official Paper Review with Pytorch Implementation
👮 [ELECTRA] Pre-training Text Encoders as Discriminators Rather Than Generators
ELECTRA Official Paper Review with Pytorch Implementation
🧑🏫 [DistilBERT] DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter
DistilBERT Official Paper Review with Pytorch Implementation
🤖 [Transformer] Attention Is All You Need
Transformer Official Paper Review with Pytorch Implementation
🪢 [DeBERTa] DeBERTa: Decoding-Enhanced BERT with Disentangled-Attention
Transformer Official Paper Review with Pytorch Implementation
🌆 [ViT] An Image Is Worth 16x16 Words: Transformers For Image Recognition At Scale
ViT Official Paper Review with Pytorch Implementation
Linear Algebra
🔥 Pytorch Tensor Indexing 자주 사용하는 메서드 모음집
파이토치에서 자주 사용하는 텐서 인덱싱 관련 메서드 모음
🗄️ SVD: Singular Value Decomposition
💡 Concept of Singular Value Decomposition
🔢 Eigen Decomposition
💡 Concept of Eigen Decomposition
🔢 Vector Space: Linear Independent, Span, Sub-space, Column Space, Rank, Basis, Null Space
💡 Concept of main sub-space
📐 Inner Product: Projection Matrix, Least Sqaure Method
💡 Concept & Insight of Inner Product
📏 Lp-Norm: Concept & Insight
Concept of Lp-Norm & GeM Pool
Transformer
🌆 [Linear Attention] Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention
Linear Attention Official Paper Review with Pytorch Implementation
👮 [ELECTRA] Pre-training Text Encoders as Discriminators Rather Than Generators
ELECTRA Official Paper Review with Pytorch Implementation
🤖 [Transformer] Attention Is All You Need
Transformer Official Paper Review with Pytorch Implementation
🪢 [DeBERTa] DeBERTa: Decoding-Enhanced BERT with Disentangled-Attention
Transformer Official Paper Review with Pytorch Implementation
🌆 [ViT] An Image Is Worth 16x16 Words: Transformers For Image Recognition At Scale
ViT Official Paper Review with Pytorch Implementation
BERT
🌆 [Linear Attention] Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention
Linear Attention Official Paper Review with Pytorch Implementation
🗂️[SpanBERT] SpanBERT: Improving Pre-training by Representing and Predicting Spans
SpanBERT Official Paper Review with Pytorch Implementation
👮 [ELECTRA] Pre-training Text Encoders as Discriminators Rather Than Generators
ELECTRA Official Paper Review with Pytorch Implementation
🧑🏫 [DistilBERT] DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter
DistilBERT Official Paper Review with Pytorch Implementation
🪢 [DeBERTa] DeBERTa: Decoding-Enhanced BERT with Disentangled-Attention
Transformer Official Paper Review with Pytorch Implementation
Error Handling
🎲 RuntimeError: CUDA error: CUBLAS_STATUS_ALLOC_FAILED when calling cublasCreate(hand≤)
Pytorch Error: Mis-match between pre-defined dimension and input dimension
🎲 RuntimeError: CUDA error: device-side assert triggered
Pytorch Error: Mis-match between pre-defined dimension and input dimension
🪢 assert len(optimizer_state[“found_inf_per_device”]) > 0, “No inf checks were recorded for this optimizer.” AssertionError: No inf checks were recorded for this optimizer.
Pytorch Error: Optimizer can’t backward loss
🤔 RuntimeError: Function ‘LogSoftmaxBackward0’ returned nan values in its 0th output
Pytorch Error: Backward NaN values
CUDA
🎲 RuntimeError: CUDA error: CUBLAS_STATUS_ALLOC_FAILED when calling cublasCreate(hand≤)
Pytorch Error: Mis-match between pre-defined dimension and input dimension
🎲 RuntimeError: CUDA error: device-side assert triggered
Pytorch Error: Mis-match between pre-defined dimension and input dimension
🪢 assert len(optimizer_state[“found_inf_per_device”]) > 0, “No inf checks were recorded for this optimizer.” AssertionError: No inf checks were recorded for this optimizer.
Pytorch Error: Optimizer can’t backward loss
CS
👨⏰🐍 [Python] 시간복잡도 2
시간 복잡도 줄이기
👨⏰🐍 [Python] 시간복잡도 1
시간 복잡도에 대한 이해
👨💻🐍 [Python] Function Argument
함수 인자 전달 메커니즘에 대한 이해
👨💻🐍 [Python] List & Tuple
List, Tuple에 대한 이해
Graph
👩💻🎄 [baekjoon] 1987번: 알파벳
백준 1987번: 알파벳
👩💻🎄 [baekjoon] 16920번: 확장게임
백준 16920번: 확장게임
👩💻🎄 [baekjoon] 15558번: 점프 게임
백준 15558번: 점프 게임 풀이
Optimization Theory
📈 Gradient: Directional Derivative
Proof of gradient direction with Total Derivative
🍎 Newton-Raphson Method for Optimization
최적화 문제를 위한 뉴턴-랩슨 메서드 설명
🗂️ Convex Optimization Problem
컨백스 최적화 문제 증명
Calculus
🔢 Product & Quotient Rule: 곱의 미분, 몫의 미분
곱의 미분, 몫의 미분 공식 유도
📈 Chain Rule: 합성함수 미분법
합성함수 미분법 공식 유도
📈 Gradient: Directional Derivative
Proof of gradient direction with Total Derivative
Dimension Mismatch
🎲 RuntimeError: CUDA error: CUBLAS_STATUS_ALLOC_FAILED when calling cublasCreate(hand≤)
Pytorch Error: Mis-match between pre-defined dimension and input dimension
🎲 RuntimeError: CUDA error: device-side assert triggered
Pytorch Error: Mis-match between pre-defined dimension and input dimension
DeBERTa
🪢 [DeBERTa-V3] DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharing
DeBERTa-V3 Official Paper Review with Pytorch Implementation
🪢 [DeBERTa] DeBERTa: Decoding-Enhanced BERT with Disentangled-Attention
Transformer Official Paper Review with Pytorch Implementation
Encoder
🤖 [Transformer] Attention Is All You Need
Transformer Official Paper Review with Pytorch Implementation
🪢 [DeBERTa] DeBERTa: Decoding-Enhanced BERT with Disentangled-Attention
Transformer Official Paper Review with Pytorch Implementation
Function
👨⏰🐍 [Python] 시간복잡도 1
시간 복잡도에 대한 이해
👨💻🐍 [Python] Function Argument
함수 인자 전달 메커니즘에 대한 이해
Argument
👨⏰🐍 [Python] 시간복잡도 1
시간 복잡도에 대한 이해
👨💻🐍 [Python] Function Argument
함수 인자 전달 메커니즘에 대한 이해
mutable
👨⏰🐍 [Python] 시간복잡도 1
시간 복잡도에 대한 이해
👨💻🐍 [Python] Function Argument
함수 인자 전달 메커니즘에 대한 이해
BFS
👩💻🎄 [baekjoon] 16920번: 확장게임
백준 16920번: 확장게임
👩💻🎄 [baekjoon] 15558번: 점프 게임
백준 15558번: 점프 게임 풀이
SVD
🗄️ SVD: Singular Value Decomposition
💡 Concept of Singular Value Decomposition
🔢 Eigen Decomposition
💡 Concept of Eigen Decomposition
PCA
🗄️ SVD: Singular Value Decomposition
💡 Concept of Singular Value Decomposition
🔢 Eigen Decomposition
💡 Concept of Eigen Decomposition
ELECTRA
👮 [ELECTRA] Pre-training Text Encoders as Discriminators Rather Than Generators
ELECTRA Official Paper Review with Pytorch Implementation
🪢 [DeBERTa-V3] DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharing
DeBERTa-V3 Official Paper Review with Pytorch Implementation
Linear-Attention
🌆 [Linear Attention] Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention
Linear Attention Official Paper Review with Pytorch Implementation
🎡 [Roformer] RoFormer: Enhanced Transformer with Rotary Position Embedding
Roformer Official Paper Review with Pytorch Implementation
Norm
📏 Lp-Norm: Concept & Insight
Concept of Lp-Norm & GeM Pool
Pooling
📏 Lp-Norm: Concept & Insight
Concept of Lp-Norm & GeM Pool
Inner Product
📐 Inner Product: Projection Matrix, Least Sqaure Method
💡 Concept & Insight of Inner Product
Projection Matrix
📐 Inner Product: Projection Matrix, Least Sqaure Method
💡 Concept & Insight of Inner Product
내적
📐 Inner Product: Projection Matrix, Least Sqaure Method
💡 Concept & Insight of Inner Product
정사영
📐 Inner Product: Projection Matrix, Least Sqaure Method
💡 Concept & Insight of Inner Product
Logsoftmax
🤔 RuntimeError: Function ‘LogSoftmaxBackward0’ returned nan values in its 0th output
Pytorch Error: Backward NaN values
NaN
🤔 RuntimeError: Function ‘LogSoftmaxBackward0’ returned nan values in its 0th output
Pytorch Error: Backward NaN values
DataLoader
🚚 RuntimeError: stack expects each tensor to be equal size, but got [32] at entry 0 and [24] at entry 1
Pytorch Error: Dataloader get non-equal size of tensor
collate_fn
🚚 RuntimeError: stack expects each tensor to be equal size, but got [32] at entry 0 and [24] at entry 1
Pytorch Error: Dataloader get non-equal size of tensor
Dynamic Padding
🚚 RuntimeError: stack expects each tensor to be equal size, but got [32] at entry 0 and [24] at entry 1
Pytorch Error: Dataloader get non-equal size of tensor
Padding
🚚 RuntimeError: stack expects each tensor to be equal size, but got [32] at entry 0 and [24] at entry 1
Pytorch Error: Dataloader get non-equal size of tensor
nn.Embedding
🎲 RuntimeError: CUDA error: CUBLAS_STATUS_ALLOC_FAILED when calling cublasCreate(hand≤)
Pytorch Error: Mis-match between pre-defined dimension and input dimension
linear independent
🔢 Vector Space: Linear Independent, Span, Sub-space, Column Space, Rank, Basis, Null Space
💡 Concept of main sub-space
span
🔢 Vector Space: Linear Independent, Span, Sub-space, Column Space, Rank, Basis, Null Space
💡 Concept of main sub-space
sub-space
🔢 Vector Space: Linear Independent, Span, Sub-space, Column Space, Rank, Basis, Null Space
💡 Concept of main sub-space
vector space
🔢 Vector Space: Linear Independent, Span, Sub-space, Column Space, Rank, Basis, Null Space
💡 Concept of main sub-space
rank
🔢 Vector Space: Linear Independent, Span, Sub-space, Column Space, Rank, Basis, Null Space
💡 Concept of main sub-space
column space
🔢 Vector Space: Linear Independent, Span, Sub-space, Column Space, Rank, Basis, Null Space
💡 Concept of main sub-space
null space
🔢 Vector Space: Linear Independent, Span, Sub-space, Column Space, Rank, Basis, Null Space
💡 Concept of main sub-space
basis
🔢 Vector Space: Linear Independent, Span, Sub-space, Column Space, Rank, Basis, Null Space
💡 Concept of main sub-space
Computer Vision
🌆 [ViT] An Image Is Worth 16x16 Words: Transformers For Image Recognition At Scale
ViT Official Paper Review with Pytorch Implementation
Vision Transformer
🌆 [ViT] An Image Is Worth 16x16 Words: Transformers For Image Recognition At Scale
ViT Official Paper Review with Pytorch Implementation
ViT
🌆 [ViT] An Image Is Worth 16x16 Words: Transformers For Image Recognition At Scale
ViT Official Paper Review with Pytorch Implementation
Image Classification
🌆 [ViT] An Image Is Worth 16x16 Words: Transformers For Image Recognition At Scale
ViT Official Paper Review with Pytorch Implementation
RoBERTa
🪢 [DeBERTa] DeBERTa: Decoding-Enhanced BERT with Disentangled-Attention
Transformer Official Paper Review with Pytorch Implementation
Disentangled-Attention
🪢 [DeBERTa] DeBERTa: Decoding-Enhanced BERT with Disentangled-Attention
Transformer Official Paper Review with Pytorch Implementation
Relative Position Embedding
🪢 [DeBERTa] DeBERTa: Decoding-Enhanced BERT with Disentangled-Attention
Transformer Official Paper Review with Pytorch Implementation
EMD
🪢 [DeBERTa] DeBERTa: Decoding-Enhanced BERT with Disentangled-Attention
Transformer Official Paper Review with Pytorch Implementation
Seq2Seq
🤖 [Transformer] Attention Is All You Need
Transformer Official Paper Review with Pytorch Implementation
Decoder
🤖 [Transformer] Attention Is All You Need
Transformer Official Paper Review with Pytorch Implementation
Object
👨💻🐍 [Python] Object Attribute & Assertion Function
getattr, setattr, delattr, hasattr, Assertion 사용방법
Attribute
👨💻🐍 [Python] Object Attribute & Assertion Function
getattr, setattr, delattr, hasattr, Assertion 사용방법
Assertion
👨💻🐍 [Python] Object Attribute & Assertion Function
getattr, setattr, delattr, hasattr, Assertion 사용방법
ML
👨💻🐍 [Python] Object Attribute & Assertion Function
getattr, setattr, delattr, hasattr, Assertion 사용방법
Deep Learning
👨💻🐍 [Python] Object Attribute & Assertion Function
getattr, setattr, delattr, hasattr, Assertion 사용방법
array
👨💻🐍 [Python] List & Tuple
List, Tuple에 대한 이해
list
👨💻🐍 [Python] List & Tuple
List, Tuple에 대한 이해
tuple
👨💻🐍 [Python] List & Tuple
List, Tuple에 대한 이해
list comprehension
👨💻🐍 [Python] List & Tuple
List, Tuple에 대한 이해
Dijkstra
🗂️ Graph Theory 2: Dijkstra
Dijkstra Algorithm with Priority Queue
Floyd-Warshall
🗂️ Graph Theory 3: Floyd-Warshall
Floyd-Warshall Algorithm with DP Tabulation
MST
🗂️ Graph Theory 5: MST with Kruskal & Prim
MST with Kruskal & Prim Algorithm
Kruskal
🗂️ Graph Theory 5: MST with Kruskal & Prim
MST with Kruskal & Prim Algorithm
Prim
🗂️ Graph Theory 5: MST with Kruskal & Prim
MST with Kruskal & Prim Algorithm
collections
✏️ Summary of Useful Library for Coding Test
코딩 테스트 풀이에 자주 사용되는 파이썬 내장 라이브러리 사용법 정리
Union-Find
🗂️ Graph Theory 4: Union-Find (Disjoint Set)
Union-Find Algorithm with Disjoint Set
Convex Optimization
🗂️ Convex Optimization Problem
컨백스 최적화 문제 증명
Newton-Raphson
🍎 Newton-Raphson Method for Optimization
최적화 문제를 위한 뉴턴-랩슨 메서드 설명
Eigen Decomposition
🔢 Eigen Decomposition
💡 Concept of Eigen Decomposition
Eigen Vector
🔢 Eigen Decomposition
💡 Concept of Eigen Decomposition
Eigen Value
🔢 Eigen Decomposition
💡 Concept of Eigen Decomposition
Partial Derivative
📈 Gradient: Directional Derivative
Proof of gradient direction with Total Derivative
Total Derivative
📈 Gradient: Directional Derivative
Proof of gradient direction with Total Derivative
loss function
📈 Gradient: Directional Derivative
Proof of gradient direction with Total Derivative
Gradient
📈 Gradient: Directional Derivative
Proof of gradient direction with Total Derivative
Gradient Descent
📈 Gradient: Directional Derivative
Proof of gradient direction with Total Derivative
Machine Learning
📈 Gradient: Directional Derivative
Proof of gradient direction with Total Derivative
Singular Value Decomposition
🗄️ SVD: Singular Value Decomposition
💡 Concept of Singular Value Decomposition
Singular Vector
🗄️ SVD: Singular Value Decomposition
💡 Concept of Singular Value Decomposition
Singular Value
🗄️ SVD: Singular Value Decomposition
💡 Concept of Singular Value Decomposition
Product Rule
🔢 Product & Quotient Rule: 곱의 미분, 몫의 미분
곱의 미분, 몫의 미분 공식 유도
Quotient Rule
🔢 Product & Quotient Rule: 곱의 미분, 몫의 미분
곱의 미분, 몫의 미분 공식 유도
Tensor
🔥 Pytorch Tensor Indexing 자주 사용하는 메서드 모음집
파이토치에서 자주 사용하는 텐서 인덱싱 관련 메서드 모음
DFS
👩💻🎄 [baekjoon] 1987번: 알파벳
백준 1987번: 알파벳
BackTracking
👩💻🎄 [baekjoon] 1987번: 알파벳
백준 1987번: 알파벳
DeBERTa-V3
🪢 [DeBERTa-V3] DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharing
DeBERTa-V3 Official Paper Review with Pytorch Implementation
Weight Sharing
🪢 [DeBERTa-V3] DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharing
DeBERTa-V3 Official Paper Review with Pytorch Implementation
GDES
🪢 [DeBERTa-V3] DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharing
DeBERTa-V3 Official Paper Review with Pytorch Implementation
DistilBERT
🧑🏫 [DistilBERT] DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter
DistilBERT Official Paper Review with Pytorch Implementation
GAN
👮 [ELECTRA] Pre-training Text Encoders as Discriminators Rather Than Generators
ELECTRA Official Paper Review with Pytorch Implementation
Roformer
🎡 [Roformer] RoFormer: Enhanced Transformer with Rotary Position Embedding
Roformer Official Paper Review with Pytorch Implementation
Transformation Matrix
🎡 [Roformer] RoFormer: Enhanced Transformer with Rotary Position Embedding
Roformer Official Paper Review with Pytorch Implementation
Complex Space
🎡 [Roformer] RoFormer: Enhanced Transformer with Rotary Position Embedding
Roformer Official Paper Review with Pytorch Implementation
SpanBERT
🗂️[SpanBERT] SpanBERT: Improving Pre-training by Representing and Predicting Spans
SpanBERT Official Paper Review with Pytorch Implementation
Kernel Trick
🌆 [Linear Attention] Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention
Linear Attention Official Paper Review with Pytorch Implementation
Time Complexity
👨⏰🐍 [Python] 시간복잡도 2
시간 복잡도 줄이기
LoRA
🔪 [LoRA] Low-Rank Adaptation of Large Language Models
LoRA Official Paper Review with Pytorch Implementation
Low-Rank Adaptation
🔪 [LoRA] Low-Rank Adaptation of Large Language Models
LoRA Official Paper Review with Pytorch Implementation
Fine-Tune
🔪 [LoRA] Low-Rank Adaptation of Large Language Models
LoRA Official Paper Review with Pytorch Implementation
Optimization
🔪 [LoRA] Low-Rank Adaptation of Large Language Models
LoRA Official Paper Review with Pytorch Implementation
Huggingface
🔪 [LoRA] Low-Rank Adaptation of Large Language Models
LoRA Official Paper Review with Pytorch Implementation
PEFT
🔪 [LoRA] Low-Rank Adaptation of Large Language Models
LoRA Official Paper Review with Pytorch Implementation