B T3 14-15 Xilinx MIPI CSI-2 for Multi Camera · PDF fileüMaximum CSI-2 Instances that...
-
Upload
vuongduong -
Category
Documents
-
view
238 -
download
5
Transcript of B T3 14-15 Xilinx MIPI CSI-2 for Multi Camera · PDF fileüMaximum CSI-2 Instances that...
![Page 1: B T3 14-15 Xilinx MIPI CSI-2 for Multi Camera · PDF fileüMaximum CSI-2 Instances that can be implemented on ... Long Distance Using Bridge IC’s CSI-2Rx Video ... B T3 14-15 Xilinx](https://reader034.fdocuments.in/reader034/viewer/2022042513/5a7935977f8b9aee3b8b852c/html5/thumbnails/1.jpg)
Kondalarao PolisettiSenior Design Engineer , Xilinx
MIPI CSI-2SM for Multi-camera, Long Range Use Cases and Implementation Methods Using FPGAs
![Page 2: B T3 14-15 Xilinx MIPI CSI-2 for Multi Camera · PDF fileüMaximum CSI-2 Instances that can be implemented on ... Long Distance Using Bridge IC’s CSI-2Rx Video ... B T3 14-15 Xilinx](https://reader034.fdocuments.in/reader034/viewer/2022042513/5a7935977f8b9aee3b8b852c/html5/thumbnails/2.jpg)
©2017MIPIAlliance,Inc.
Agenda• MIPI CSI-2 Introduction & Features• Camera Market & Projections• Multi-camera & Long Distance Use Case(s)• System Requirements• Value of FPGA for MIPI CSI-2• Q & A
2
Xilinx
![Page 3: B T3 14-15 Xilinx MIPI CSI-2 for Multi Camera · PDF fileüMaximum CSI-2 Instances that can be implemented on ... Long Distance Using Bridge IC’s CSI-2Rx Video ... B T3 14-15 Xilinx](https://reader034.fdocuments.in/reader034/viewer/2022042513/5a7935977f8b9aee3b8b852c/html5/thumbnails/3.jpg)
©2017MIPIAlliance,Inc.
mipi.org• MIPIAlliance: Developingtheworld’smostcomprehensiveset
ofinterfacespecificationsformobileandmobile-influencedproducts.
3
Source:mipi.orgXilinx
![Page 4: B T3 14-15 Xilinx MIPI CSI-2 for Multi Camera · PDF fileüMaximum CSI-2 Instances that can be implemented on ... Long Distance Using Bridge IC’s CSI-2Rx Video ... B T3 14-15 Xilinx](https://reader034.fdocuments.in/reader034/viewer/2022042513/5a7935977f8b9aee3b8b852c/html5/thumbnails/4.jpg)
©2017MIPIAlliance,Inc.
MIPICSI-2FeaturesNote:MIPICSI-2SM 1.1,MIPID-PHYSM 1.1consideredinthispresentation.
• Multi-lanesupport(1.5Gbps/Lane)• Multipledatatypes(RAW,RGB,YUV)• Interleaving(VC,Datatype)
4
Xilinx
![Page 5: B T3 14-15 Xilinx MIPI CSI-2 for Multi Camera · PDF fileüMaximum CSI-2 Instances that can be implemented on ... Long Distance Using Bridge IC’s CSI-2Rx Video ... B T3 14-15 Xilinx](https://reader034.fdocuments.in/reader034/viewer/2022042513/5a7935977f8b9aee3b8b852c/html5/thumbnails/5.jpg)
©2017MIPIAlliance,Inc.
MIPICSI-2Features
5
Xilinx
![Page 6: B T3 14-15 Xilinx MIPI CSI-2 for Multi Camera · PDF fileüMaximum CSI-2 Instances that can be implemented on ... Long Distance Using Bridge IC’s CSI-2Rx Video ... B T3 14-15 Xilinx](https://reader034.fdocuments.in/reader034/viewer/2022042513/5a7935977f8b9aee3b8b852c/html5/thumbnails/6.jpg)
©2017MIPIAlliance,Inc.
MIPICSI-2Features
6
Xilinx
![Page 7: B T3 14-15 Xilinx MIPI CSI-2 for Multi Camera · PDF fileüMaximum CSI-2 Instances that can be implemented on ... Long Distance Using Bridge IC’s CSI-2Rx Video ... B T3 14-15 Xilinx](https://reader034.fdocuments.in/reader034/viewer/2022042513/5a7935977f8b9aee3b8b852c/html5/thumbnails/7.jpg)
©2017MIPIAlliance,Inc.
CameraProjections
7
• Cameramarketbyapplication
Source:grandviewresearch.comXilinx
![Page 8: B T3 14-15 Xilinx MIPI CSI-2 for Multi Camera · PDF fileüMaximum CSI-2 Instances that can be implemented on ... Long Distance Using Bridge IC’s CSI-2Rx Video ... B T3 14-15 Xilinx](https://reader034.fdocuments.in/reader034/viewer/2022042513/5a7935977f8b9aee3b8b852c/html5/thumbnails/8.jpg)
©2017MIPIAlliance,Inc.
Automotive-ADASProjections
8
Source:IHSXilinx
![Page 9: B T3 14-15 Xilinx MIPI CSI-2 for Multi Camera · PDF fileüMaximum CSI-2 Instances that can be implemented on ... Long Distance Using Bridge IC’s CSI-2Rx Video ... B T3 14-15 Xilinx](https://reader034.fdocuments.in/reader034/viewer/2022042513/5a7935977f8b9aee3b8b852c/html5/thumbnails/9.jpg)
©2017MIPIAlliance,Inc.
VideoSurveillanceProjections
9
Source:IHSXilinx
![Page 10: B T3 14-15 Xilinx MIPI CSI-2 for Multi Camera · PDF fileüMaximum CSI-2 Instances that can be implemented on ... Long Distance Using Bridge IC’s CSI-2Rx Video ... B T3 14-15 Xilinx](https://reader034.fdocuments.in/reader034/viewer/2022042513/5a7935977f8b9aee3b8b852c/html5/thumbnails/10.jpg)
©2017MIPIAlliance,Inc.
Multi-cameraSystems
10
CSI-2Rx VideoProcessing
Visualization
Multiplechannels,multipleinstances
Singlechannel,singleinstanceHowmanycam’scanbesupported?Systemlevelaspectsinsuchdesigns
Howmanycam’scanbesupported?Systemlevelaspectsinsuchdesignsü Bandwidth
ü Protocolsupportü MuxChipsupport
ü Bandwidthü Protocolsupportü MuxChipsupportü IOSupport
CSI-2Rx VideoProcessing
VisualizationCSI-2Rx
CSI-2RxVideo
ProcessingVisualization
MuxChip
CSI-2RxMuxChip
CSI-2Rx VideoProcessing
Visualization
MuxChip
Type-1 Type-2Xilinx
![Page 11: B T3 14-15 Xilinx MIPI CSI-2 for Multi Camera · PDF fileüMaximum CSI-2 Instances that can be implemented on ... Long Distance Using Bridge IC’s CSI-2Rx Video ... B T3 14-15 Xilinx](https://reader034.fdocuments.in/reader034/viewer/2022042513/5a7935977f8b9aee3b8b852c/html5/thumbnails/11.jpg)
©2017MIPIAlliance,Inc.
Systemaspects-Type1
11
VC=0,RAW8
VC=1,RAW8
VC=2,RAW8
VC=3,RAW8
MIPICSI-2MuxChip
MIPISingleChannel
VC=0,RAW10
VC=1,RAW10
VC=2,RAW10
VC=3,RAW10
VC=0,RAW12
VC=1,RAW12
VC=2,RAW12
VC=3,RAW12
üTotalbandwidthavailableüInterleavingassupportedMIPICSI-2SpecificationüMaximuminputchannelssupportedbymuxchip
CSI-2Rx VideoProcessing
Visualization
MuxChip
Howmanycam’scanbesupported?Systemlevelaspectsinsuchdesigns
Xilinx
![Page 12: B T3 14-15 Xilinx MIPI CSI-2 for Multi Camera · PDF fileüMaximum CSI-2 Instances that can be implemented on ... Long Distance Using Bridge IC’s CSI-2Rx Video ... B T3 14-15 Xilinx](https://reader034.fdocuments.in/reader034/viewer/2022042513/5a7935977f8b9aee3b8b852c/html5/thumbnails/12.jpg)
©2017MIPIAlliance,Inc.
Systemaspects-Type2
12
üTotalbandwidthavailableüInterleavingassupportedMIPICSI-2SpecificationüMaximuminputchannelssupportedbymuxchipüMaximumCSI-2Instancesthatcanbeimplementedonthechip
VC=0,RAW8
VC=1,RAW8
VC=2,RAW8
VC=3,RAW8
MIPICSI-2MuxChip
VC=0,RAW10
VC=1,RAW10
VC=2,RAW10
VC=3,RAW10
VC=0,RAW12
VC=1,RAW12
VC=2,RAW12
VC=3,RAW12
VC=0,RAW8
VC=1,RAW8
VC=2,RAW8
VC=3,RAW8
MIPICSI-2MuxChip
VC=0,RAW10
VC=1,RAW10
VC=2,RAW10
VC=3,RAW10
VC=0,RAW12
VC=1,RAW12
VC=2,RAW12
VC=3,RAW12
MIPICSI-2RxInstances
CSI-2RxVideo
ProcessingVisualization
MuxChip
CSI-2RxMuxChip
Howmanycam’scanbesupported?Systemlevelaspectsinsuchdesigns
ü Protocolsupportü MuxChipsupportü IOSupport
Xilinx
![Page 13: B T3 14-15 Xilinx MIPI CSI-2 for Multi Camera · PDF fileüMaximum CSI-2 Instances that can be implemented on ... Long Distance Using Bridge IC’s CSI-2Rx Video ... B T3 14-15 Xilinx](https://reader034.fdocuments.in/reader034/viewer/2022042513/5a7935977f8b9aee3b8b852c/html5/thumbnails/13.jpg)
©2017MIPIAlliance,Inc.
SystemRequirements-Type1
13
• 1920x1080@30fps,RAW8->Requires~0.74Gbps
Bandwidth Interleaving MuxChip
6/0.74=8
1.5Gbps,4L=6
4*1=4
VC=4DT=1(RAW8)
Letssay‘4’
BasedonChip
min(8,4,4)=4
Xilinx
![Page 14: B T3 14-15 Xilinx MIPI CSI-2 for Multi Camera · PDF fileüMaximum CSI-2 Instances that can be implemented on ... Long Distance Using Bridge IC’s CSI-2Rx Video ... B T3 14-15 Xilinx](https://reader034.fdocuments.in/reader034/viewer/2022042513/5a7935977f8b9aee3b8b852c/html5/thumbnails/14.jpg)
©2017MIPIAlliance,Inc.
SystemRequirements-Type2
14
• 1920x1080@30fps,RAW8->Requires~0.74Gbps
Bandwidth Interleaving MuxChip
6/0.74=8
1.5Gbps,4L=6
4*1=4
VC=4DT=1(RAW8)
Letssay‘4’
BasedonChip
IOSupport
BasedonFPGAIO
AutoGrade US+supports8
InstanceswithNativeIO’s
min(8,4,4)=4CSI-2Instances=8MaxCam’s=4*8=32
Xilinx
![Page 15: B T3 14-15 Xilinx MIPI CSI-2 for Multi Camera · PDF fileüMaximum CSI-2 Instances that can be implemented on ... Long Distance Using Bridge IC’s CSI-2Rx Video ... B T3 14-15 Xilinx](https://reader034.fdocuments.in/reader034/viewer/2022042513/5a7935977f8b9aee3b8b852c/html5/thumbnails/15.jpg)
©2017MIPIAlliance,Inc. 15
Source:mipi.org
SurroundView
TrafficSignPark
Assistance
LaneDeparture
SurroundView
Multi-camera&LongDistanceUseCase(s)
Xilinx
![Page 16: B T3 14-15 Xilinx MIPI CSI-2 for Multi Camera · PDF fileüMaximum CSI-2 Instances that can be implemented on ... Long Distance Using Bridge IC’s CSI-2Rx Video ... B T3 14-15 Xilinx](https://reader034.fdocuments.in/reader034/viewer/2022042513/5a7935977f8b9aee3b8b852c/html5/thumbnails/16.jpg)
©2017MIPIAlliance,Inc. 16
LongDistanceUsingBridgeIC’s
CSI-2Rx VideoProcessing
Visualization
MuxChip
BridgeIC
ConvertsMIPID-PHYSMtoLVDS
ConvertsLVDStoMIPID-PHYSM
MIPIInterfacesmaybeconvertedto/fromthesehighspeedtransportsinbridgechipswhenlengthexceedMIPISpecificationlengths
Supportedcablelength,data rateetc.,determined
byBridgeIC
BridgeIC
Xilinx
![Page 17: B T3 14-15 Xilinx MIPI CSI-2 for Multi Camera · PDF fileüMaximum CSI-2 Instances that can be implemented on ... Long Distance Using Bridge IC’s CSI-2Rx Video ... B T3 14-15 Xilinx](https://reader034.fdocuments.in/reader034/viewer/2022042513/5a7935977f8b9aee3b8b852c/html5/thumbnails/17.jpg)
©2017MIPIAlliance,Inc. 17
Xilinx
ValueofFPGAforMIPICSI-2• Mostflexible&scalableplatformformaximumreuseandbest
TTMü ImplementEnd-to-Endsystemswithease
• LatestFPGAscanspeakMIPID-PHYü SingleChip(PHY+Controller),reducesBOM.MoreD-PHYinterfacesperchip(>16)ü Flexibleinterfaces:Lanes(1,2,3,4),Datarates,VCfilteringetc..
• LatestFPGAsbuiltonacommonreal-timeprocessor andprogrammablelogic equippedplatformenablesunlimitedpossibilitiesfornextgenerationADASapplicationsü InnovativeARM®+FPGAarchitecturefordifferentiation,analytics&control
![Page 18: B T3 14-15 Xilinx MIPI CSI-2 for Multi Camera · PDF fileüMaximum CSI-2 Instances that can be implemented on ... Long Distance Using Bridge IC’s CSI-2Rx Video ... B T3 14-15 Xilinx](https://reader034.fdocuments.in/reader034/viewer/2022042513/5a7935977f8b9aee3b8b852c/html5/thumbnails/18.jpg)
©2017MIPIAlliance,Inc.
Q&A
18
Xilinx
![Page 19: B T3 14-15 Xilinx MIPI CSI-2 for Multi Camera · PDF fileüMaximum CSI-2 Instances that can be implemented on ... Long Distance Using Bridge IC’s CSI-2Rx Video ... B T3 14-15 Xilinx](https://reader034.fdocuments.in/reader034/viewer/2022042513/5a7935977f8b9aee3b8b852c/html5/thumbnails/19.jpg)