Software Engineer

Brief DescriptionWe’re looking to hire an experienced Software Engineer with strong expertise in Apache NiFi and enterprise data flows for our client’s high-impact project in Dubai. This role offers the opportunity to design, develop, and optimize production-grade data pipelines in a secure, high-performance environment. Location: Dubai Experience Required: 5+ years in Apache NiFi, data flow engineering, and related technologies Role Highlights

Lead the design, development, and optimization of complex Apache NiFi data flows.

Work with Cloudera NiFi (CDP Data Flow) and integrate with Cloudera Manager.

Ensure secure, high-availability NiFi deployments and monitor performance using tools like Prometheus/Grafana.

Collaborate with cross-functional teams to implement best practices for enterprise data pipelines.

Key Responsibilities

Design, implement, and optimize NiFi flows in production environments.

Migrate NiFi flows across major version upgrades while maintaining backward compatibility.

Develop scripts using Groovy for ExecuteScript and InvokeScriptedProcessor processors.

Integrate NiFi with MongoDB and Apache Kafka, handling data ingestion, transformation, and schema evolution.

Implement secure data handling using processors like EncryptContent and manage SFTP/SSH connections.

Monitor and troubleshoot NiFi flows using Data Provenance, bulletins, and log analysis.

Participate in setting up secure NiFi clusters, user authentication, TLS certificates, and access policies.

Preferred SkillsSkills Required

Hands-on experience with Apache NiFi and Cloudera NiFi (CDP Data Flow)

Strong Groovy scripting skills for NiFi processors

Knowledge of SSH/SFTP protocols, secure file handling, and encryption mechanisms

Experience with MongoDB (GetMongo, PutMongo, QueryMongo)

Experience with Apache Kafka (Produce/Consume, Confluent Schema Registry)

Proficient in RHEL environments and JVM tuning for NiFi

Expertise in NiFi flow design principles, controller services, parameter contexts, and NiFi Registry

Good to Have

Custom processor development in Java/Groovy

Familiarity with DevOps workflows, CI/CD, and automated deployment strategies

Experience in regulated or secure environments with audit and compliance requirements

Strong documentation and mentoring skills

How to Apply Interested candidates may send their CVs to mail@nagainfo.com