Skip to content

@Zyphra Zyphra

Change the repository type filter

All

    Repositories list

    23 repositories

    • transformers_zamba

      Public
      🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
      Python
      •
      Apache License 2.0
      •28k•3•0•0•Updated Jan 28, 2025Jan 28, 2025

    • transformers_zamba2

      Public
      Python
      •
      Apache License 2.0
      •1•42•7•0•Updated Jan 24, 2025Jan 24, 2025

    • Zamba2

      Public
      PyTorch implementation of models from the Zamba2 series.
      Python
      •
      Apache License 2.0
      •16•173•3•1•Updated Jan 23, 2025Jan 23, 2025

    • bci_minRF

      Public
      Minimal implementation of scalable rectified flow transformers, based on SD3's approach
      Jupyter Notebook
      •
      Apache License 2.0
      •41•0•0•0•Updated Jan 23, 2025Jan 23, 2025

    • zcookbook

      Public
      Training hybrid models for dummies.
      Python
      •
      Apache License 2.0
      •2•18•0•1•Updated Jan 16, 2025Jan 16, 2025

    • tree_attention

      Public
      Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters
      Python
      •5•113•1•0•Updated Dec 3, 2024Dec 3, 2024

    • FastChat

      Public
      An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
      Python
      •
      Apache License 2.0
      •4.6k•0•0•0•Updated Nov 6, 2024Nov 6, 2024

    • Megatron-LM

      Public
      Ongoing research training transformer models at scale
      Python
      •
      Other
      •2.5k•0•10•4•Updated Aug 20, 2024Aug 20, 2024

    • Megatron-DeepSpeed

      Public
      Ongoing research training transformer language models at scale, including: BERT & GPT-2
      Python
      •
      Other
      •2.5k•0•0•2•Updated Aug 19, 2024Aug 19, 2024

    • flash-attention

      Public
      Fast and memory-efficient exact attention
      Python
      •
      BSD 3-Clause "New" or "Revised" License
      •1.4k•0•0•0•Updated Jul 8, 2024Jul 8, 2024

    • Zamba-torch

      Public
      Python
      •
      Apache License 2.0
      •1•7•0•0•Updated Jul 1, 2024Jul 1, 2024

    • mamba

      Public
      Python
      •
      Apache License 2.0
      •1.2k•4•0•0•Updated Jun 27, 2024Jun 27, 2024

    • lm-evaluation-harness

      Public
      A framework for few-shot evaluation of language models.
      Python
      •
      MIT License
      •2k•0•0•0•Updated Jun 20, 2024Jun 20, 2024

    • Zyda_processing

      Public
      Python
      •
      Apache License 2.0
      •1•31•1•0•Updated Jun 19, 2024Jun 19, 2024

    • PowerInfer

      Public
      High-speed Large Language Model Serving on PCs with Consumer-grade GPUs
      C++
      •
      MIT License
      •418•1•0•0•Updated Jun 11, 2024Jun 11, 2024

    • TemporalMemoryDataset

      Public
      Dataset for the temporal memory tests
      0•3•0•0•Updated Jun 4, 2024Jun 4, 2024

    • alignment-handbook

      Public
      Robust recipes to align language models with human and AI preferences
      Python
      •
      Apache License 2.0
      •428•0•0•0•Updated Jun 3, 2024Jun 3, 2024

    • zamba-minimal

      Public
      Simple, minimal implementation of the Mamba SSM in one file of PyTorch.
      Python
      •
      Apache License 2.0
      •200•0•0•0•Updated Mar 8, 2024Mar 8, 2024

    • BlackMamba

      Public
      Code repository for Black Mamba
      Python
      •18•234•5•0•Updated Feb 8, 2024Feb 8, 2024

    • tokenizers

      Public
      💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
      Rust
      •
      Apache License 2.0
      •833•1•0•1•Updated Feb 3, 2024Feb 3, 2024

    • transformers

      Public
      🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
      Python
      •
      Apache License 2.0
      •28k•2•0•0•Updated Jan 25, 2024Jan 25, 2024

    • DeepSpeed

      Public
      DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
      Python
      •
      Apache License 2.0
      •4.2k•0•0•0•Updated Nov 2, 2023Nov 2, 2023

    • apex

      Public
      A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch
      Python
      •
      BSD 3-Clause "New" or "Revised" License
      •1.4k•0•0•0•Updated Nov 1, 2023Nov 1, 2023