Data
We cover every stage of a training run.
A model is shaped by what it is fed and by when it is fed. The axis below is the map we work against.
The training lifecycle
Select a stop to see the data it takes. Custom sits off the axis on purpose: it is not a stage, it is a spec.
Pretraining
Breadth sets the ceiling on what a model can ever know.
- Text
- Long-form posts from publisher accounts, parsed into records and collected daily
- Question-and-answer threads carrying every answer, not the accepted one alone
- News and print-media archives retaining outlet, date and section, each language separate
- Subject books and annual research volumes keeping chapter structure, epub and pdf alongside
- Journal articles, conference papers and dissertations, figures and reference lists intact
- Filings, research notes and first-hand investor call minutes, none of them summarized
- K-12 item banks with image sets, university and certification banks split by discipline
- Genomic and protein sequence records with their annotation fields
- Code
- Private repositories with full commit history, issues, and review threads
- Per-repository license, language mix, and production status on record
- Credential, personal-data, and malware scan results recorded per repository
- Speech
- Spoken-interview audio across Southeast Asian, African, and Pacific languages
- Read and conversational speech with time-aligned transcripts per language
- Paired audio, video, and subtitle tracks, translation where present
- Quarterly earnings calls shipping as audio with the matching transcript
- Music tracks in lossless and compressed form, each with its lyric file
- Image
- Document scans with layout regions and reading order preserved
- Medical imaging series paired with structured findings and impressions
- Satellite and GIS layers with co-registered segmentation masks
- Engineering project sets pairing photographs, drawings, and approval filings
- Artist works paired with the written description filed for each piece
- Video
- Multi-view capture with camera parameters and per-frame depth
- Egocentric task video indexed by activity category
- Scripted action footage paired with a move-by-move log
- Aerial survey footage over terrain and built environments
Need something not described here?
Tell us the capability and where the gap sits. We source, build, and validate against your acceptance criteria.