MLX75027 VGA Time-of-Flight Sensor DATASHEET v1.0 Features & Benefits Description 1/2 optical Time-of-Flight image sensor MLX75027 is a fully integrated optical Time-of- VGA (640 x 480) pixel array Flight image sensor. Its perfectly suited for 10 x 10 m DepthSense pixels automotive applications, including, but not Integrated microlenses limited to, gesture recognition, driver Backside illumination (BSI technology) monitoring, skeleton tracking, people or obstacle External quantum efficiency 51% (850nm) detection and traffic monitoring. The sensor External quantum efficiency 28% (940nm) features a VGA (640x480) pixel array based on High distance accuracy due to programmable the DepthSense pixel technology. Combined modulating frequencies up to 100 MHz with a modulated light source this sensor is AC Demodulation contrast 85 % (40 MHz) capable of measuring object distance and AC Demodulation contrast 78 % (100 MHz) reflectivity under extreme background light Differential light source control with phase conditions, 120KLUX robust when using lens with delay feedback loop filter. This distance information can be used to Full resolution distance framerate of calculate a complete 3D point cloud max. 120 FPS (4 phases, Tint 300s, 4lane representation of a scene. Full resolution image data 960mbps MIPI configuration) acquisition up to 120 distance frames per second Up to 8 raw phases (or quads) per frame while supplied to a microcontroller via a Per-phase statistics & diagnostics standardized MIPI CSI-2 serial camera interface. Continuous or triggered operation mode(s) The device is available in a ceramic BGA package 2 Configurable over I C (up to 400kHz) and offers a variety of integration possibilities. CSI-2 serial data output, MIPI D-PHY, 1 clock lane, 2 or 4 data lanes (< 960 Mbps/lane) Build-in temperature sensor Region of interest (ROI) selection Integrated support for binning (2x2, 4x4, 8x8) Horizontal mirror & vertical flip image modes 14 x 14 x 2.2 mm ceramic BGA package Number of pins = 141 Ambient operating temperature range of -40 - 105C MSL level 3 rated AEC-Q100 qualified (grade 2) MLX75027 VGA Time-of-Flight Sensor Table of Contents Features & Benefits..................................................................................................................... 1 Description.................................................................................................................................. 1 Table of Contents ........................................................................................................................ 2 Document Revision History ......................................................................................................... 5 Ordering Information .................................................................................................................. 6 1. System Architecture ................................................................................................................ 7 2. Sensor Block Diagram .............................................................................................................. 8 3. Electrical Specifications ........................................................................................................... 9 3.1. Absolute Maximum Ratings ................................................................................................... 9 3.2. Typical Operating Conditions ................................................................................................. 9 3.3. Video Interface .................................................................................................................... 10 3.4. Power Consumption ............................................................................................................ 11 3.5. Maximum Distance Frame Rate .......................................................................................... 13 3.6. Decoupling Recommendations ............................................................................................ 13 3.7. Power-up Sequence ............................................................................................................. 14 3.8. Input Clock Requirements ................................................................................................... 14 2 3.9. I C Specifications .................................................................................................................. 15 4. Optical Characteristics .......................................................................................................... 16 4.1. VGA Pixel Array Configuration ............................................................................................. 16 4.2. Pixel & Image Array Characteristics ..................................................................................... 17 4.3. CRA (Chief Ray Angle) .......................................................................................................... 18 4.4. MTF (Modulation Transfer Function) .................................................................................. 19 4.5. Application Lens Design Recommendations ........................................................................ 19 5. Communication Interface(s) .................................................................................................. 20 2 5.1. I C (Inter-Integrated Circuit) ................................................................................................ 20 5.2. MIPI Alliance CSI-2 Description ............................................................................................ 24 6. Start-up Sequence ................................................................................................................. 26 6.1. Initialization Process ............................................................................................................ 27 6.2. Initialization Register Map ................................................................................................... 28 7. Register Settings ................................................................................................................... 30 7.1. Video Output Configuration ................................................................................................ 30 7.2. Modes of Operation ............................................................................................................ 31 7.3. Data Output Modes ............................................................................................................. 32 Datasheet v1.0 Page 2 of 67 3901075027