Senior Market Data Engineer

Role Responsibilities

End-to-End Data Lifecycle Management: Independently spearhead the full-lifecycle pipeline development for high-frequency historical MBO (Market-By-Order) data across one or more core markets. Responsibilities span vendor sample evaluation, high-performance PCAP parser development, full-scale historical backfilling, high-standard data quality verification (Sanity Checks), and production-ready delivery.

Data Sourcing & Proactive Quality Control: Leverage deep data engineering expertise to lead or deeply participate in the evaluation and technical onboarding of high-frequency market data vendors. Proactively identify and assess data quality risks (e.g., known gaps, packet loss, bandwidth/frequency coverage) prior to procurement, minimizing the cost of redundant purchasing and rework from the source.

Exchange Architecture & Pitfall Mitigation: Utilize a profound understanding of market microstructure and raw exchange feeds to precisely identify and resolve structural pitfalls during the design and acceptance phases (e.g., CME Implied Orders, symbol mapping, sequence number discontinuity, and timestamp precision), ensuring early convergence of data defects.

New Market Onboarding & Protocol Adaptation: Lead the market data onboarding, micro-protocol parsing, and standardized normalization at the MBO level for new global exchanges and trading systems.

Multi-Source Cross-Validation Framework: Build a multi-dimensional, multi-granular data cross-validation framework (including but not limited to MBO vs. TAQ, Bloomberg historical data, and Raw PCAP vs. Normalized Data) to guarantee absolute data accuracy, consistency, and robustness.

Team Empowerment & Standardization: Responsible for mentoring junior engineers and talent pipeline development. Cultivate and institutionalize team-level sanity check protocols, high-frequency data engineering best practices, and standardized delivery whitepapers.

Requirements

Experience & Background: 5+ years of experience in global exchange market data/tick data engineering, with a proven track record of successfully implementing full-lifecycle, large-scale historical MBO data projects across multiple markets.

Core Technical Stack: Highly proficient in C++ with exceptional capabilities in native PCAP processing and low-level raw data parsing. Deep understanding of high-frequency market microstructure, with hands-on mastery of Order Book Reconstruction, Snapshot Recovery, and latency-sensitive data alignment techniques (e.g., A/B arbitrage alignment).

Vendor Evaluation Expertise: Extensive practical experience in direct exchange feeds and major international third-party market data vendors (e.g., MayStreet, Pico, Databento, Refinitiv, QuantHouse). Proven ability to conduct vendor selection, sample evaluation, and quality differentiation, with a clear understanding of the underlying pain points and technical nuances of various data sources.

Domain Knowledge: Profound understanding of the underlying market data architectures of major global exchanges. Familiar with the characteristics of market data across various asset classes (with an emphasis on global derivatives/futures). Possess hands-on, practical experience in resolving critical pitfalls such as implied order processing, contract symbol mapping mechanisms, sequence number continuity validation, and multi-precision price alignment.