Dataiku Solution Architect

Solution Architect, Dataiku Applications Dataiku WebApps for human-in-the-loop business processes; Power Automate for workflow orchestration; PostgreSQL and Amazon RDS for governed data storage; and Power BI for operational, risk, and management reporting. The successful candidate will work closely with Commodity Risk, Trading, Finance, Data Engineering, Cybersecurity, Platform, Architecture, Compliance, and business stakeholders. This individual will ensure the solution is scalable, secure, auditable, supportable, and aligned with enterprise architecture standards. Key Responsibilities Solution Architecture and Technical Leadership Define and maintain the end-to-end solution architecture for the IPV Control Hub across data acquisition, processing, workflow, storage, reporting, security, and governance layers. Translate business, risk, audit, security, and regulatory requirements into scalable technical architecture and solution designs. Establish the architectural standards, integration principles, reusable patterns, and technical guardrails for the platform. Create solution architecture diagrams, data-flow diagrams, integration designs, interface specifications, security models, and deployment views. Provide technical leadership throughout design, development, testing, deployment, transition, and production stabilization. Evaluate design alternatives and recommend solutions based on scalability, auditability, resiliency, security, maintainability, and operational support requirements. Ensure clear separation of responsibilities across Dataiku, Power Automate, PostgreSQL or Amazon RDS, Power BI, and connected enterprise systems. Facilitate architecture reviews, technical design workshops, and solution walkthroughs with business and technology stakeholders. Identify architectural dependencies, design risks, integration constraints, and nonfunctional requirements early in the delivery lifecycle. Dataiku Architecture Define the Dataiku architecture supporting ingestion, data preparation, transformation, business-rule processing, consensus pricing, variance calculation, threshold evaluation, historical replay, and exception management. Establish standards for Dataiku projects, Flows, datasets, managed folders, recipes, scenarios, plugins, APIs, applications, and reusable components. Design scalable Dataiku processing frameworks that support more than 70 internal and external data sources, including structured and unstructured data. Define metadata-driven frameworks for managing brokers, source priorities, mappings, thresholds, currencies, units of measure, regional variations, approval paths, and business rules. Design reusable Dataiku project templates and onboarding patterns for new brokers, market-data providers, commodities, regions, and business processes. Establish Dataiku development, testing, production, version-control, promotion, deployment, and rollback standards. Define monitoring, alerting, failure handling, restart, recovery, and operational support patterns for Dataiku processes. Ensure Dataiku processing is deterministic, traceable, version-controlled, and capable of reproducing historical IPV runs. Guide the migration of legacy Microsoft Access queries, Excel formulas, macros, and VBA logic into controlled Dataiku processing frameworks. Partner with Dataiku engineers and developers to review application designs, integration components, Python code, SQL logic, reusable recipes, and deployment configurations. Dataiku Application and WebApp Architecture Lead the architecture and design of Dataiku applications and WebApps used as the primary business interface for IPV operations. Design user experiences that support Last Deal Done capture, mandatory commentary, exception review, threshold-breach management, approvals, rejections, override requests, and rationale capture. Define application components that allow authorized business users to manage source mappings, broker configurations, thresholds, prioritization rules, validation rules, and regional settings. Design role-based application views for Commodity Risk, Trading, Finance, ARC, administrators, and operational support users. Ensure Dataiku applications provide clear processing status, validation results, exception queues, approval history, and audit evidence. Establish architecture patterns for communication between Dataiku WebApps, Dataiku processing pipelines, PostgreSQL or Amazon RDS, Power Automate, and Power BI. Ensure application activity, including changes, approvals, rejections, overrides, comments, and resubmissions, is recorded in the governed evidence repository. Define application performance, availability, usability, security, logging, and support requirements. Promote configuration-driven application behavior to reduce hard-coded logic and minimize the need for code changes when business rules are updated. Enterprise Systems Integration Define secure, resilient, and supportable integrations between Dataiku and internal or external enterprise systems. Architect integrations with PostgreSQL, Amazon RDS, Power Automate, Power BI, Murex, SOLARC, Position Manager, ONTAP, shared mailboxes, exposure systems, broker feeds, exchange data, market reports, web services, and APIs. Establish interface standards for REST APIs, database connections, file transfers, event-driven processes, batch integrations, and workflow callbacks. Define common data-exchange standards using formats such as JSON, XML, XSD, CSV, and Parquet. Design governed ingestion patterns for broker marks, exchange prices, market reports, Last Deal Done values, position data, exposure data, and internal valuation curves. Define integration patterns for both structured and unstructured files, including PDFs, images, spreadsheets, text files, API feeds, and email attachments. Architect interfaces supporting OCR and text extraction for broker files received in PDF or image-based formats. Ensure integrations include validation, duplicate detection, reconciliation, error handling, retry logic, operational monitoring, and evidence capture. Define data contracts and interface specifications for source and downstream systems. Ensure integration designs reduce point-to-point dependencies and support future source onboarding through common, reusable patterns. Power Automate and Workflow Integration Define the division of responsibilities between Power Automate, Dataiku, and the governed data repository. Architect Power Automate workflows that monitor shared mailboxes, retrieve attachments, route files through approved gateway connections, and deliver data to the ONTAP landing zone. Design workflow integrations for notifications, approvals, exception routing, escalations, resubmissions, and processing-status updates. Establish secure communication and status synchronization between Power Automate workflows and Dataiku processing pipelines. Ensure workflow decisions and approval outcomes are written to the governed evidence repository. Design workflows that support segregation of duties, controlled access, traceable decision-making, and auditable approval history. Define handling patterns for incomplete submissions, unsupported formats, failed validations, duplicate files, late-arriving data, and processing exceptions. Murex and Options Integration Define the solution architecture for options data processing through Dataiku. Design the integration that generates XSD/XML outputs for delivery to the Murex ONTAP location. Define the controlled exchange of data between Dataiku, Murex, ONTAP, and PostgreSQL. Architect the return of Murex P