Full Time
Openings : 2
Job Overview:
We are seeking an experienced NiFi Engineer to join our internal team. The ideal candidate will be responsible for designing, implementing, and optimizing data ingestion workflows using Apache NiFi. You will work closely with various teams to ensure seamless integration with different systems, perform system administration, and maintain high performance and reliability.
Roles & Responsibilities:
Develop and implement data ingestion workflows using Apache NiFi.
Manage and administer NiFi instances, including performance tuning and cluster management.
Ensure the smooth operation and maintenance of NiFi systems.
Work with various file formats and transformation technologies.
Create scripts to manage NiFi workflows and integrations.
Troubleshoot and resolve issues related to NiFi data flows and processor performance.
Conduct performance tuning at both processor and cluster levels.
Monitor NiFi system performance.
Required Skills:
At least 2+ yrs in implementing data ingestion flow using NiFi.
In-depth understanding of software development life cycle principles, practice, and disciplines.
Knowledge of various in-built NiFi processors.
Prior experience integrating NiFi with SQL/NoSQL databases, S3/Azure Blob Storage, and SNS/Kafka.
Knowledge of various file and transformation formats like CSV, JSON, XML, Avro, Parquet, XLS, XLSX, and XSLT.
A good understanding of NiFi Administration and Maintenance.
Basic knowledge of NiFi REST API, MiNiFi , NiFi Registry and implementing a Flow Registry for storing and managing versioned flows.
Deep knowledge of NiFi Controller services.
Hands-on experience with NiFi functions.
Good Debugging skills.
Profound knowledge of Performance tuning on processor and cluster level.
Experience working with scripting languages like python, groovy, shell scripting.
Experience monitoring systems like Prometheus/Grafana.
