Apache NiFi Getting Started …

Tijo Thomas Srinath Thota

Systems Fail Data access exceeds capacity to consume Boundary conditions are mere suggestion Business Priority Systems evolve at different rates Compliance and security Continuous improvement occurs in production

Source : https://www.confluent.io/blog/stream-data-platform-1/

Systems Fail

◦ Networks fail, disks fail, software crashes

Data access exceeds capacity to consume

◦ Sometimes a given data source can outpace some part of the processing

Boundary conditions are mere suggestion

◦ You will invariably get data that is too big, too small, too fast, too slow, corrupt, wrong, or in the wrong

format.

Business Priority

◦ Priorities of an organization change – rapidly

Systems evolve at different rates

◦ The protocols and formats used by a given system can change anytime and often irrespective of the systems

around them

Compliance and security

Continuous improvement occurs in production

Web based user interface for creating , monitoring and controlling data

flow

Graph based approach for data routing and transformation

Highly configurable

Dynamic prioritization at runtime

Provenance

Back pressure

Easy Extensions - Create your own components

Twitter feed Ingestion

Multi Source Data Ingestion

Key Differentiator Provide Bi Directional Communication NiFi is installed in the Data center MiNiFi is a light weight client for Nifi can be installed in any IOT devices