Chris Collins

Code AI, ML and NLP

CPP Attention Transformer Demo

This C++ project implements a complete Transformer neural network with training and inference capabilities, utilizing Metal acceleration for improved performance. The project features a multi-head attention mechanism, positional encoding, layer normalization, feed-forward networks, and supports tokenization, model serialization, and saving train...

View on GitHub

Repository
geekychris/cpp_attention_transformer_demo
Language
C++
Last updated

transformermetalcpp