Solutions Architect - Cyber Security

Solution Architect, Dataiku Applications & Integrations Position Summary We are seeking an experienced Solution Architect with Dataiku application and integration expertise to lead the architecture and technical design of a modern Independent Price Verification (IPV) platform supporting a global Refined Product Trading organization. The Solution Architect will define the end-to-end architecture for a governed, metadata-driven IPV Control Hub that replaces fragmented Excel, Microsoft Access, VBA, and email-based processes with an automated, controlled, and SOX-compliant enterprise solution. The platform will use Dataiku for data ingestion, transformation, business-rule execution, historical replay, and application development; PostgreSQL and Amazon RDS for governed data storage; and Power BI for operational, risk, and management reporting. The successful candidate will work closely with Commodity Risk, Trading, Finance, Data Engineering, Cybersecurity, Platform, Architecture, Compliance, and business stakeholders. Define and maintain the end-to-end solution architecture for the IPV Control Hub across data acquisition, processing, workflow, storage, reporting, security, and governance layers. Translate business, risk, audit, security, and regulatory requirements into scalable technical architecture and solution designs. Create solution architecture diagrams, data-flow diagrams, integration designs, interface specifications, security models, and deployment views. Provide technical leadership throughout design, development, testing, deployment, transition, and production stabilization. Ensure clear separation of responsibilities across Dataiku, Power Automate, PostgreSQL or Amazon RDS, Power BI, and connected enterprise systems. Identify architectural dependencies, design risks, integration constraints, and nonfunctional requirements early in the delivery lifecycle. Define the Dataiku architecture supporting ingestion, data preparation, transformation, business-rule processing, consensus pricing, variance calculation, threshold evaluation, historical replay, and exception management. Establish standards for Dataiku projects, Flows, datasets, managed folders, recipes, scenarios, plugins, APIs, applications, and reusable components. Design scalable Dataiku processing frameworks that support more than 70 internal and external data sources, including structured and unstructured data. Define metadata-driven frameworks for managing brokers, source priorities, mappings, thresholds, currencies, units of measure, regional variations, approval paths, and business rules. Design reusable Dataiku project templates and onboarding patterns for new brokers, market-data providers, commodities, regions, and business processes. Establish Dataiku development, testing, production, version-control, promotion, deployment, and rollback standards. Define monitoring, alerting, failure handling, restart, recovery, and operational support patterns for Dataiku processes. Guide the migration of legacy Microsoft Access queries, Excel formulas, macros, and VBA logic into controlled Dataiku processing frameworks. Partner with Dataiku engineers and developers to review application designs, integration components, Python code, SQL logic, reusable recipes, and deployment configurations. Design user experiences that support Last Deal Done capture, mandatory commentary, exception review, threshold-breach management, approvals, rejections, override requests, and rationale capture. Define application components that allow authorized business users to manage source mappings, broker configurations, thresholds, prioritization rules, validation rules, and regional settings. Design role-based application views for Commodity Risk, Trading, Finance, ARC, administrators, and operational support users. Establish architecture patterns for communication between Dataiku WebApps, Dataiku processing pipelines, PostgreSQL or Amazon RDS, Power Automate, and Power BI. Define application performance, availability, usability, security, logging, and support requirements. Promote configuration-driven application behavior to reduce hard-coded logic and minimize the need for code changes when business rules are updated. Architect integrations with PostgreSQL, Amazon RDS, Power Automate, Power BI, Murex, SOLARC, Position Manager, ONTAP, shared mailboxes, exposure systems, broker feeds, exchange data, market reports, web services, and APIs. Establish interface standards for REST APIs, database connections, file transfers, event-driven processes, batch integrations, and workflow callbacks. Define common data-exchange standards using formats such as JSON, XML, XSD, CSV, and Parquet. Design governed ingestion patterns for broker marks, exchange prices, market reports, Last Deal Done values, position data, exposure data, and internal valuation curves. Ensure integrations include validation, duplicate detection, reconciliation, error handling, retry logic, operational monitoring, and evidence capture. Define data contracts and interface specifications for source and downstream systems. Define the division of responsibilities between Power Automate, Dataiku, and the governed data repository. Architect Power Automate workflows that monitor shared mailboxes, retrieve attachments, route files through approved gateway connections, and deliver data to the ONTAP landing zone. Define handling patterns for incomplete submissions, unsupported formats, failed validations, duplicate files, late-arriving data, and processing exceptions. Define the solution architecture for options data processing through Dataiku. Design the integration that generates XSD/XML outputs for delivery to the Murex ONTAP location. Define the controlled exchange of data between Dataiku, Murex, ONTAP, and PostgreSQL. Architect the return of Murex P&L calculation outputs to the governed data foundation. Ensure appropriate validation, reconciliation, lineage, and audit evidence exist across inbound and outbound Murex processes. Promote the use of shared data models, workflow components, audit controls, and reporting layers across Forwards and Options where appropriate. Coordinate with Murex, Trading, Commodity Risk, platform, and data teams to resolve interface dependencies and clarify system responsibilities. Data Architecture and Processing Define a canonical IPV data model that supports RPTA, RPTAP, and RPTE while accommodating governed regional variations. Architect the governed data foundation supporting raw source data, normalized data, consensus prices, variance calculations, exposure impacts, workflow decisions, approvals, evidence, and reporting outputs. Define data-layering, naming, ownership, quality, retention, archival, and purge standards. Establish designs for currency conversion, unit-of-measure normalization, source prioritization, contributor counts, tolerance evaluation, and threshold-breach identification. Define data-quality controls, reconciliation points, exception rules, and completeness checks across the IPV lifecycle. Ensure data structures support historical analysis, operational reporting, audit inquiries, and replay of previous processing cycles. Lead the design of a centralized Metadata Control Plane governing source onboarding, validation, transformation, approval routing, audit evidence generation, reporting, and historical replay. Define metadata structures for sources, brokers, commodities, regions, mappings, thresholds, currencies, units of measure, business rules, approval paths, and retention policies. Establish governance processes for creating, reviewing, approving, versioning, activating, and retiring metadata configurations. Design effective-dating and versioning approaches so historical runs can be reproduced using the configurations that were active at the time. Define end-to-end lineage across source acquisition, transformation, consensus construction, variance analysis, approvals, reporting, and downstream outputs. Ensure every ingestion event, transformation, business-rule execution, threshold breach, override, approval, rejection, and output is traceable and auditable. Ensure the platform supports three-year business-data retention and purge requirements, as specified in the proposal. Define segregation-of-duties controls across development, configuration, administration, business processing, approval, and production support activities. Ensure architecture alignment with applicable Information Security and Cyber Resilience policies, MITS requirements, IAM standards, and secrets-management controls. Define role-based access-control models for Dataiku applications, platform projects, datasets, workflows, reports, databases, and administrative capabilities. Ensure service identities, credentials, tokens, database connections, and API secrets are stored and managed through approved secrets-management solutions. Ensure sensitive trading, valuation, position, and exposure data is protected throughout ingestion, processing, storage, reporting, and archival. Partner with cybersecurity and architecture-review teams to complete security assessments and resolve design findings. Define the reporting architecture supporting Power BI dashboards and analytical consumption. Establish semantic-model and reporting-data requirements in collaboration with Power BI developers and business stakeholders. Ensure dashboards use controlled, reconciled, and traceable data from the governed platform. Define access, refresh, performance, lineage, and reconciliation standards for reporting solutions. Support curve observability and the monitoring of data quality, source availability, processing status, and workflow completion. Define nonfunctional requirements for performance, scalability, security, availability, resiliency, recoverability, observability, maintainability, and supportability. Design monitoring and alerting across Dataiku, Power Automate, PostgreSQL or Amazon RDS, integrations, WebApps, and reporting components. Establish recovery patterns for failed source deliveries, workflow errors, data-quality issues, integration failures, and interrupted processing. Define capacity and performance considerations for regional processing, historical replay, concurrent users, data growth, and peak IPV-cycle workloads. Ensure the architecture supports controlled deployment and minimal disruption to business operations. Serve as the primary architecture liaison across Commodity Risk, Trading, Finance, Technology, Security, Compliance, Audit, and delivery teams. Convert business processes and control requirements into detailed technical designs and implementation roadmaps. Partner with Dataiku engineers, integration developers, database engineers, Power BI developers, testers, DevOps teams, and platform administrators. Participate in Agile ceremonies, sprint planning, backlog refinement, solution demonstrations, and release-readiness reviews. Support testing strategy, including system integration testing, regression testing, performance testing, security testing, user acceptance testing, and control validation. Provide architecture support during deployment, production transition, stabilization, and operational handover. Develop technical documentation and knowledge-transfer materials for engineering and production-support teams. Bachelors degree in Computer Science, Information Systems, Engineering, Data Science, or a related field. Significant experience in solution architecture, data architecture, application architecture, or enterprise integration architecture. Strong understanding of Dataiku Flows, recipes, datasets, managed folders, scenarios, plugins, APIs, automation, and deployment processes. Experience designing metadata-driven and configuration-driven data-processing platforms. Strong knowledge of Python and SQL-based data solutions. Experience integrating Dataiku with databases, APIs, file systems, enterprise applications, workflow platforms, and reporting tools. Experience with PostgreSQL, Amazon RDS, or comparable relational database platforms. Experience defining REST API, database, batch-file, XML, and event-based integration patterns. Experience designing solutions with data lineage, traceability, audit logging, version control, role-based access, and evidence retention. Experience translating business and regulatory requirements into solution architecture and technical designs. Experience working in Agile delivery environments and leading architecture across multidisciplinary teams. Experience in energy trading, refined products, commodities, financial services, market risk, valuation, or regulatory reporting. Experience delivering applications or data platforms in a SOX-controlled environment. Experience replacing legacy Excel, VBA, Access, and email-based business processes. Experience with Power Automate and Power BI. Experience integrating with Murex or comparable trading and risk platforms. Familiarity with SOLARC, Position Manager, ONTAP, market-data providers, broker feeds, and exchange-pricing sources. Experience designing OCR or document-intelligence integrations for PDFs and image-based files. Familiarity with IAM, secrets management, single sign-on, Saviynt, Accsys, and enterprise cybersecurity controls. Python and SQL PostgreSQL and Amazon RDS Power BI JSON, XML, XSD, CSV, and Parquet Data modeling and metadata management Git, CI/CD, version control, and deployment governance Data lineage, audit logging, retention, and historical replay Cloud and hybrid integration architecture End-to-end IPV Control Hub solution architecture. Dataiku processing and project-design standards. Canonical IPV data model. Environment, deployment, and release-management strategy. Monitoring, alerting, and operational-support architecture. Delivery of an approved, scalable, and supportable architecture for the IPV Control Hub. Successful implementation of Dataiku applications and integrations across the IPV lifecycle. Migration of legacy Excel, Access, VBA, and email-driven processes into governed platform services. Reduction in manual processing and dependence on institutional knowledge. Successful integration of Forwards and Options processes with the governed data and workflow platform. Alignment with SOX, cybersecurity, IAM, data-retention, and enterprise architecture requirements.