Chapter 05
C / 05
Competencies
The disciplines and instruments that underwrite my architectural practice.
§ Five Disciplines
01
Enterprise Data Architecture
◆Data Platforms, Data Lakes, Lakehouses and logical Data Warehouses
◆Enterprise Data Object modelling
◆Domain, canonical, event, temporal and longitudinal modelling
◆Data-product and semantic-layer design
◆Metadata-driven and contract-first architecture
◆Federated and multi-domain data environments
02
Data Engineering
◆Batch and streaming ingestion
◆ETL and ELT
◆CDC and replication
◆Python, Airflow, Spark, PySpark, Kafka
◆REST APIs and controlled file exchange
◆Idempotent loading, replay, schema evolution
03
Governance and Quality
◆Technical and semantic metadata
◆Field-level lineage
◆Data catalogues and publication gates
◆Quality rules, quarantine and reject tables
◆Masking, pseudonymisation, retention, audit
◆Reproducibility and versioning
04
Advanced Analytics and AI
◆Feature spaces and training datasets
◆Anomaly detection, process mining, graph analytics
◆Entity resolution — deterministic and confidence-based matching
◆NLP, embeddings and semantic search
◆RAG foundations
05
Healthcare and Scientific Standards
◆HL7 v2, FHIR, CDA, C-CDA
◆DICOM, OMOP CDM
◆OME-Zarr, OME-NGFF
◆Genomic formats (FASTQ, VCF), laboratory models
◆Biobank and specimen traceability
§ Technology Landscape
The instruments of the practice, grouped by function.
Databases
- — PostgreSQL
- — Microsoft SQL Server
- — Oracle
- — Oracle RAC
- — Oracle Exadata
- — MySQL
NoSQL & Distributed
- — MongoDB
- — Cassandra
- — HBase
- — Redis
- — CouchDB
- — Hadoop
- — Cloudera
Streaming & Integration
- — Apache Kafka
- — Airbyte
- — REST
- — OpenAPI
- — JSON
- — XML
- — CSV
- — Controlled file exchange
Cloud & Platform Engineering
- — Kubernetes
- — Docker
- — Helm
- — Terraform
- — Azure
- — Google Cloud
- — Object storage
- — Databricks
Data Formats
- — Parquet
- — JSONB
- — OME-Zarr
- — OME-NGFF
- — DICOM
- — FASTQ
- — VCF
- — OpenDocument
Governance & Validation
- — Collibra
- — JSON Schema
- — Pydantic
- — Great Expectations
- — Deequ
- — Unity Catalog
Observability
- — Prometheus
- — Grafana
- — Alertmanager
- — Loki
- — OpenSearch
ETL & Enterprise Integration
- — SSIS
- — IBM DataStage
- — Talend
- — Informatica PowerCenter
- — SAS Data Integration
- — Oracle Data Integrator
- — Oracle GoldenGate