Steve Castledine

Steve Castledine

IT Consultant, Solution Architect, Software, Data, Cloud Engineer

Personal Statement

An experienced Consultant with a background in solution/integration architecture and software, cloud, data engineering.

My experience and skills mean I can perform many roles from Solution Architect, Technical Lead, Software Engineering in multiple languages, Data Engineering, Cloud Engineering with experience across multiple industries including Financial Services, Retail, Warehousing/Supply Chain and Government.

My current technical focus areas are around the Microsoft Azure cloud ecosystem, Informatica for ETL and Databricks for data processing.

I like to plan, communicate, keep things simple and just get it done, and get it done right. I also learn and adapt quickly and have great experience in adopting new technologies and techniques to suit the customers environment and way of working.

Key Skills

Solution Consulting/architecture, System / Data Integration, Technical Lead, Software Development (Python, JavaScript, Java), Linux, Cloud (AWS/Azure/IBM), Data platforms (Azure, Databricks, Informatica).

Skills

Linux, Python, JavaScript, Java, Shell, Groovy, SQL, Eclipse, Git, Cloud, JSON, REST, Hadoop, Databricks, Databases – experience of MySQL,PostGreSQL, SQLite, NoSQL, DB2, Oracle, SQL Server, IBM XPages (JSF), LotusScript, HTML, CSS, Dojo, Accessibility, Agile, IBM Notes, IBM Domino, IBM WebSphere, IBM MDM, IBM BPM, IBM StoredIQ, IBM StoredIQ For Legal, Informatica ETL EDC DEI, Knowledge using Jenkins, Chef, CI/CD pipelines, Docker, AWS, Azure (storage/compute/networking/vaults/functions/logic apps/data factory)

Current Role

Senior Consultant for Informatica (Big Data and Emerging Technologies) since January 2020.

An in the field services consultant for big data solution delivery, lead technical advisory, integration and data/software engineering skills for large organisations deploying and integrating Informatica products and solutions on cloud.

Main focus of my role is delivering consulting for Data Engineering and Data Cataloging platforms and integrating with AWS and Azure clouds (mainly Azure) and Databricks.

Previous Role

Technical Consultant, Solution Architect, IBM Data and AI Services March 2017 until January 2020

Working on data projects using my technical lead skills to design and implement customer integrations and solutions with IBM products (IBM Cloud Big data platform, MDM, Data Discovery with StoredIQ, Legal hold management with StoredIQ for Legal).

Disciplines

Consulting / Managing / Architect / Advocate

I have spent the past 4/5 years in a ‘Services Consultant and Solution Architecture’ role at IBM and then Informatica. I'm used to leading technical direction and designing solutions whilst also getting on with the technical work.

I have experience of supervising support and engineering staff both onsite and offshore. Recently this was with a Python and Integration engineering project, prior to that supporting and advocating for a large big data project on the IBM Cloud, and also supervising offshore Java engineers for an MDM project, which included travel to India.

As part of a previous IBM labs role, I was also an Advocate for IBM software products and engineering on them. I frequently visited customers to talk about this, and spoke at a lot of conferences in many different countries, had articles published. I also ran open source projects on behalf of IBM.

Data Engineering

I am used to designing, using, performing ETL/data integration across many different systems. As well as hard coding ETL using Python, I have also installed and used platforms to handle this which includes products from Informatica, IBM, Microsoft, Databricks.

As part of software engineering projects, integration requirements, consultancy etc I have done a lot of work with Databases and SQL. I'm no master DBA but have worked on creating data models, schemas, databases, tables, views, reports on DB2, Oracle, SQL Server, PostgreSQL, SQLite and nosql when required.

For the last year I have spent most of my time working on data platform solutions using a combination of Informatica DEI, Microsoft Azure and Databricks. Therefore I have experience of engineering data platform solutions for data lake, lake house/delta lake purposes using these platforms, with additional linux, python, etl, Azure cloud skills from source through ingestion and on to the processing layers. In addition, I understand and can design the dev/data ops processes around this orchestration.

Software Engineering

I have been a professional software engineer in various languages and on lots of platforms for most of my career. I can (and love to) learn new ones.

I have written code in Java, JavaScript, Python, React, Node.js, Electron, HTML, CSS and more over the years. I am used to Git, code pipelines and writing code for on prem and in the cloud (especially on web servers, web applications and using REST API’s).

For the most recent software engineering I spent most of 2019 designing and coding a Python 3 framework on RHEL Linux platform to perform data integration and automation functions across systems at a large Bank.

I was also a full-time software engineer within IBM labs for 11 years. For most of those years I wrote Java, as well as other languages such as JavaScript and other web technologies.

Cloud Engineering

I spent many years working for IBM SmartCloud. This involved writing software for and supporting cloud-based software. So I understand the nature of software delivery in a cloud environment and how you have to engineer this to have 99.9% uptime.

Most of my current experience is with Azure and pretty much understand and have experience of the full stack from networking/security through compute/storage (including adls2), Data Factory, logic apps/functions, key vaults etc and with my software engineering skills I can design or build complete end to end solutions, whatever the requirement.

I have also worked with AWS and understand similar concepts to Azure but not with the same depth.

eDiscovery

Part of my Consultancy role at IBM was around a product StoredIQ (eDiscovery). I installed and configured this product (linux containerised appliance) at various organisations and then designed data capture and analysis (regex mainly) using the product in order to assess the data landscape for GDPR purposes, data retention, mergers and aquisitions data discovery.

In addition to StoredIQ I also worked extensively with a product StoredIQ For Legal (they do connect but otherwise are completely different). I can install, configure, develop on and integrate this product in the enterprise. I can therefore write BPMN as a workflow developer and know the consult and data model required to use this product as a Legal Hold management system.

Data Governance

As well as GDPR projects using StoredIQ, I have also worked on Master Data Management (MDM) projects as part of a data governance strategy. I can install and configure IBM Websphere and Information Server together with MDM components. I can also consult on the data strategy and write extensions to the main product in Java. As an extension to this I can also work with IBM MQ and IBM BPM and setup the DB2 or Oracle databases.

I have also worked on metadata catalog projects, curating a master catalog of metadata and data resources across the enterprise to provide insight into where data is, what type, what is the quality and what does the lineage look like.

Other stuff

As part of enterprise projects I have worked on I am experienced in Linux, SSO, email, Databases - Oracle, DB2, SQlite, MySQL, SQL Server, NoSQL, PostGreSQL (i'm no DBA but I know what I need to get by), networking both at a TCP level and the actual cabling, server hardware building, Microsoft Exchange

Recent Projects

Integration of core hr/security/data systems at a bank to StoredIQ for Legal

All of 2019 and some of 2020 I spent on a single project at a bank mostly in London but some time in Zurich. This project was for introducing a new legal hold management system into a bank, performing data analysis, migrating content from an old system and integrating HR, Security, other legal hold management systems. The product being installed being IBM StoredIQ for Legal. My role on this project was as Technical Lead and Integration Architect and eventually Software Engineer for the ETL layer of the solution.

The project was interesting as it was pretty greenfield in that we started from nothing and had to find out for ourselves the processes, systems in place, and how the bank 'did things'. It took awhile to figure this out and get the design documents published and approved.

As well as installing and configuring the main product (simple really - Linux based containerised appliance), and integrating it with the usual email gateways, SSO (Siteminder), and then building the workflows using BPMN (that is a time consuming task), we also had to design and build from scratch an integration server based on RHEL7.5 with Python 3.

This Python framework then handled all data movement (and full ETL processing), mainly using csv data transfer or MS SQL database views and transforming (using an embedded SQLite database for caching/indexing) and then moving the data to REST services on the target system (some of this was some 500,000 HR records, delta'ed by this code each night). It also handled the automated server configuration, account security, migration, logging, backup and monitoring required by the bank. Tranformation's were controlled by object oriented Pyhton code and mapping files to keep it seperate from business and load logic.

The framework code itself was kept in Git and then we used Jenkins to package the code and distribute to target servers when builds were ready.

All in all this was a high pressure project and the first stage was delivered in 9 months from scratch with the all the above working with the minimal of staffing.

Career History

Senior Big Data and Emerging Technologies Engineer and Consultant

Informatica Professional Services
Informatica January 2020 onwards

Senior Big Data and Emerging Technologies Engineer and Consultant working on Informatica Big Data products and integrating with cloud (AWS, Azure) and Hadoop distributions (HDP, Cloudera, Databricks).

Solution Architect / Consultant

Data and AI Expert Lab Services
IBM March 2017 - January 2020

Consultant and Technical Lead for IBM UK Services undertaking various IT projects including:

Technical Lead and Integration Architect on a StoredIQ For Legal project providing legal hold matter management and integration for Large Bank in London and Zurich. Integration with HR, security and global legal hold systems. Designed/implemented a full integration and deployment automation suite running on Red Hat Linux server with Python 3, shell, Git, Postgres, sqlite, Jenkins, Autosys, monitoring, backup automation

Remote development/support team lead

Customer support advocate/manager of Credit Card anonymisation processing start-up in Dublin. Providing advocacy for startup within IBM and developing/managing offshore support network for large cloud-based Hadoop deployment

Technical consultant designing/deploying StoredIQ GDPR unstructured data search solutions and integrations for various banks and sporting organisations

MDM (Master Domain Management) technical consultant deploying and integrating IBM MDM solutions at Scottish Bank including working with WebSphere, IBM MQ and IBM BPM, integration and extentions using Java custom solutions

Advisory Software Engineer

Software Labs
IBM April 2006 - March 2017

Software Engineer for IBM Labs working on many products but mainly IBM SmartCloud, IBM Notes (mail/calendar), IBM Domino (blog, XPages, Gatekeeper)

Senior Java and web software engineer (javascript, CSS, HTML) for IBM SmartCloud

Lead for accessibility/bidi/security of IBM SmartCloud Notes cloud software

Lead of openntf.org open source project, Conference speaker in US and UK

Many global Customer engagements and advocacy roles

Built and delivered social solutions including blogs/wiki's applications (used by thousands of customers)

Developer advocate for IBM application development platform Domino/XPages (java/JSF)

Developer for the email/collaboration product IBM (Lotus) Notes with associated functionality such as calendar, notebook, bookmarks

Software Engineer Architect Consultant

Contractor
Self Employed April 1998 - April 2006

Designed and built a browser based factory control system accessed via the Internet and Intranet which allows personnel on factory shifts to enter information which covers things like Engineering Maintenance, Planning, Health and Safety Incidents, Day to Day planning/incident management and stock/ production control information for all of the British Sugar factories across the UK

Designed and built Competition Compliance Contact Reporting System to allow employees across the Associated British Foods companies to submit reports across the Internet for any contact with a Competitor, in order to satisfy UK compliance regulations.

Designed and built a Legal Document Framework Extranet for the ABF group of companies.

Designed and built an online E-Learning System in order to ensure employees had read and understood basic Compliance laws and procedures from the Associated British Foods Legal Extranet.

IBM Domino 6 and I-Series Migration Consultancy

IBM Domino content management system development

Design/Build Intranet E-Learning System

Architect, developer for an online food supply chain system using IBM Domino / Java / Javascript for Walmart/ASDA/Tesco/Safeway.

Browser Portal consultant/specialist/lead developer. Create Portal based system to bring all these systems together using a Java/XML/Javascript/IBM Domino solution.

Architect/developer - Application Access Security System. A high profile project for Transco in order to gain BS7799 Accreditation and to satisfy requirements in order to split the company from British Gas. An IBM Notes Client and browser based project for an integrated Security System to control the access to all of Transco’s Software and Hardware Systems.

Microsoft NT/Exchange rollout. IBM Notes development/support for the Births Death Marriages system. Server, rack and network installation.

Microsoft NT Server, Exchange architect for global rollout.

Solutions Consultant developing applications using mainly IBM Lotus Notes/Domino, Visual Basic.