data-format

Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..

Rusty Object Notation

High performance data store solution

CoffeeScript-Object-Notation. Same as JSON but for CoffeeScript objects.

Chepy is a python lib/cli equivalent of the awesome CyberChef tool.

Python library for reading and writing well data using Log ASCII Standard (LAS) files

A super-fast, compact, JSON-equivalent binary data format

A Python API for working with Neurodata stored in the NWB Format

Read and explore NetCDF files

STON - Smalltalk Object Notation - A lightweight text-based, human-readable data interchange format for class-based object-oriented languages like Smalltalk.

EDN parser and generator that works with plain JS data, with support for TS and node streams

Just Data. Save up to 85% network bandwidth and storage.

🎀 Awesome Zarr resources

Python library for working with OMF files

Parse and write environment files with Node.js

PEtab - an SBML and TSV based data format for parameter estimation problems in systems biology

Data format specification schema for the NWB neurophysiology data format

A human readable object notation / serialization format that syntactic similar to Rust and completely supports Serde's data model.

A serializer/deserializer for the rhythm game chart format simai.

Data formats for gamma-ray astronomy