Language models
Mixture-of-experts architectures, supervised fine-tuning, preference optimization, and efficient inference.
LANGUAGEHi, I’m Qiang Gao.
AI Researcher at ByteDance.
Studying intelligence. Leaving room for wonder.
I’m Qiang Gao — call me Neo — an AI Researcher at ByteDance since September 2026. My work connects language model research with real-world search and relevance systems.
I earned my master’s degree at Wuhan University, advised by Prof. Fei Li, studying information extraction and retrieval-augmented generation. Previously, I worked on LLM-powered search at Alibaba Xianyu and interned at Tencent AI Lab, exploring mixture-of-experts models and conversational game NPCs.
The field I work in.
The questions I keep coming back to.
Mixture-of-experts architectures, supervised fine-tuning, preference optimization, and efficient inference.
LANGUAGELLM-based evaluation, model distillation, query understanding, and retrieval-augmented generation.
RETRIEVALCross-document event extraction, discourse-aware representations, and faithful generation.
RESEARCHSecond author · Faithful generation
Co-author · Adaptive retrieval-augmented generation
First author · Cross-document event extraction
First author · Event coreference resolution
Second author · Multimodal language understanding
AI Researcher
AI & language modelsLLM Researcher
Search relevance, evaluation, reranking, and conversational AI search.LLM Research Intern
Mentored by Jian Li. Warm-start MoE models and conversational game NPCs.Natural Language Processing
Advisor: Fei LiEnergy and Power Engineering
Second major in Computer Science and Technology
A sketchbook for the less obvious questions.
Small experiments. Unfinished possibilities.
What if a thought could leave a visual fingerprint? Give this little drawing machine a phrase and watch it find a shape.
A procedural drawing, inspired by generative art. Runs entirely in your browser; no AI model or upload.
An imagined exhibition where two models keep describing the same picture to each other. What disappears? What becomes a story?
AI × PERCEPTION × ARTImagine translating a paragraph’s rhythm into sound: punctuation becomes silence, repetition becomes a motif, and ambiguity becomes harmony.
LANGUAGE × MUSICReading, hiking, tennis, cycling.
Different rhythms, the same curiosity.
Books offer another way to travel: through an idea, a life, or a question that stays open.
PAGES / PERSPECTIVESTime on a trail. A changing horizon. Space for thoughts to settle at their own pace.
TRAILS / OPEN AIRRhythm, attention, and the small pleasure of meeting the ball just right.
MOVEMENT / FOCUSA different speed for seeing the world. New roads, a little wind, and room to wander.
ROADS / DISCOVERYSelected industry projects,
collected by company.
Language models for search, relevance, and discovery.
Built an automated evaluation pipeline combining supervised fine-tuning, difficult-example augmentation, retrieval of similar samples, and DPO preference alignment.
SFT · RAG · DPO · Automated evaluation
Distilled a 7B teacher into a compact 0.4B discriminative reranker based on Qwen2.5. Built the serving pipeline and optimized inference with caching and FP8 quantization to extend real-time relevance scoring to long-tail queries.
Knowledge distillation · Qwen · Model serving
Developed a three-stage query understanding architecture: contextual intent understanding, query rewriting, and structured search-condition parsing. Improved relevance screening with an upgraded Qwen 7B model and retrieval-augmented knowledge.
Query understanding · Multi-turn context · RAG
Mixture-of-experts models and characters that remember.
Explored Yi-based 4-expert and 8-expert MoE models for game dialogue. Designed an NPC architecture combining event memory, knowledge retrieval, and response generation. Built a Llama 3-based MoE project with bilingual fine-tuning, YaRN context extension, and vLLM serving.
Explore llama3-8x8b-MoE ↗Mixture of experts · Memory · YaRN · vLLM