How to manage your AI projects: From Proof of Value to Production

“Every company is a technology company.”


This quote from Gartner represents businesses increasingly adopting sophisticated technologies to achieve their goals. Artificial Intelligence is one of the most important business opportunities in 2019. Knowing what it takes to apply these new technologies to work at scale and give a greater competitive edge, is the real differentiator.

In the following chapters, we provide a guide on how to manage your AI projects from proof of value to production.

As with any other technology, a business considering AI should undergo a Proof of Value (POV) to get started. With a POV you will have proof that an AI solution will, in fact, meet your business expectations. Most of these projects fail, mainly due to the fact that most teams get stuck building one or more POVs with little to no progression to an applied AI.

We previously talked about the 2 things to consider before starting an AI project, suggesting to clearly plan the impact your AI will have across the organisation, get buy-in from every department, and understand the limitations. In this blog, we identify the reasons why often AI projects don’t continue beyond a POV and the challenges of productionising your solution.

Why Proof of Values fail?

According to a recent report from McKinsey 50% of enterprise claim to have “embedded some form of AI”, however, “only 21% of respondents report embedding AI into multiple business units”. From our experience in building multiple Applied AI solutions for enterprise, we usually start with a Proof of Value. However in some cases, the POV doesn’t make it through to production, so we wanted to address the reasons why:

1. Misunderstood requirements. Make sure you know what the requirements are and what you are trying to solve/achieve from this implementation. The POV isn’t the place to refine the problem, but where you prove the value, so there has to be a clear problem you’re trying to solve or value you’re looking to create in the first place.

2. Lack of ownership. If you’re working with external parties, they will need clear communication as per point 1. However so will in-house teams where you’ll need buy-in from multiple department stakeholders to ensure your AI solution will be adopted more widely. Clear ownership by each department is crucial, but so is clear direction from one project lead. Get buy-in but be clear on who has the final say.

3. Poor change management. Understand which teams will be affected by the implementation of the new AI system and try to communicate the long term vision and objective. Engage people early on who will be using the product. They’re ultimately the ones who are affected, and also the ones who can make or break a POV.

4. Data modeling. The difference between generating the input data needed by a Machine Learning model for a POV and doing it continuously and at scale is important. The time and energy required to get the data needed are often underestimated.

In a POV, all forms of data modeling have to simplify the reality, therefore, some fidelity is always lost in the process. Ensure you cater for the drop in accuracy when moving to production, and have the right people on hand to retrain, and maintain the system while it deals with its new environment.

5. No definitive endpoint. A POV should end as soon as the desired objectives are archived, avoiding gold-plating the results to make it work if they aren’t successful. Be clear when starting the project on what the Acceptance Criteria will be so that your data scientists and engineers have a clear goal in mind.

From POV to Production

In the Production step is not rare to completely change the way your system works. It’s also safe to assume that new problems will arise as you’re are getting closer to the final release of the implementation. Let’s keep in mind that production systems won’t work on sample data but they need real-life data used to solve a real-life problem.

Not only, moving towards the final stage of AI industrialisation, AI will be implemented in multiple areas of the business and perhaps made available to a few users/customers to try. This step’s challenges include enterprise-scale infrastructure, security and support challenges.

Organisations should monitor and invest in many Proof of Values as they can relatively inexpensively learn about their potential, without getting lumbered with a useless piece of software. It’s good practice to quickly kill the ones that aren’t going anywhere, and identify the narrower group of promising ones to continue monitoring and investing resources into them.

Once you’ve identified the POV works and the project moves to a Production stage, new challenges arise in further data modeling and training.

As all the forms of data modeling are simplified for the POV, it might cause modeling issues during production. A solution to this is to minimize the gap between the real-world requirements and the POV data set. Add more detail to the model by having more fields, tables, relationships, etc., meaning that you’ll potentially need access to more data. It’s important to point out that with more data, the modeling becomes harder to carry out and understand. You’ll need to make sure that the data scientists (in-house or external) have the right expertise to create an accurate model for your AI product.

There’s an important step of any IT implementation which we like to think of as the AI’s dress rehearsal. Getting the POV deployed into testing and then staging environment will submit it to near enough real production environments, that will allow you to iron out any bugs.

The most important part of the industrialisation of the applied AI is the people who will take it over. Your teams will need to train and upskill in the system. IT teams will have to work on a new set of skills and infrastructure to implement, to keep the AI running and be able to fix issues. Plus BAU teams will need to understand the systems early limitations, and what’s a bug and what’s not. Otherwise, people will give up on the system before its hand a chance to learn in the real world.

By choosing the right partner for your AI projects, you’re ensuring solid forethought, planning, expertise and best practices. Experts will know how to treat your data without putting it at risk as well as strengthen competitive advantage by providing your teams with appropriate training and support.

About Deeper Insights™

Deeper Insights™ is a Machine Learning and Data Science Consultancy that builds Artificial Intelligence (AI) solutions for scale-ups and enterprise clients. Deeper Insights™ powerful NLP Skim Engine™ extracts and structures web data to accelerate the development of AI, insights and automation for businesses looking to innovate with external data sources such as News, Competitor Data, Market Insights or Alternative Data sets. The company has offices in London and Portugal and works with clients globally.

We help companies like yours win with AI

From finance to healthcare, from market research to media monitoring, we can help your people make better decisions. We work alongside companies like yours to help deliver successful AI and ML projects - to make a real business value impact


The challenge: Deloitte’s partners and account managers found they were drowning in news from sales support teams, and unable to react quickly to market changes

The solution: Deeper Insights built a prototype Automated Insights app allowing them to have better conversations with clients and close more business

The outcome: Account managers at Deloitte close more business thanks to actionable insights delivered straight to their phones

Client said: "There are a number of gems we’ve found that are far better than the standard services we use" - Dimitar Milanov, Partner, Deloitte


The challenge: Help the sales and marketing teams know more about their customers to enable them to drive deeper customer engagement in sales meetings

The solution: Deeper Insights developed a CMS that scraped the web and automatically identified and summarised customer events relating to key accounts at JLL

The outcome: The automation of the whole previous manual process, and being able to identify 60% more news stories than the manual process, enabling JLL have better and more informed conversations with their clients

Client said: "We have lots of researchers and people who generate insights for our clients, Deeper Insights™ (formerly Skim Technologies) helped us improve the speed at which we get insights and have better conversations with our clients." - Chris Zissis, CIO, Jones Lang LaSalle


The challenge: In the UK, the total number of Total Knee Replacements(TKA's) per year has increased from 13,546 in 2003 to 98,147 in 2019 costing the NHS an estimated £585m per year. The average cost of a TKA in the UK is £12,000, however, post-surgical complications, e.g surgical site infection, increases this cost by between £1618 and £2398 per patient.

The solution: Our consortium, which is comprised of Smith&Nephew Ltd, Deeper Insights and Imperial College London, won Innovate-UK funding to carry out an ambitious and innovative project that is focussed on developing markerless and automated registration and tracking of the patient's limbs tailored for robotic-assisted orthopedic procedures using structured light technology assisted by deep learning to continuously capture the patient's anatomy during surgery.

This new platform will be integrated within S&N's commercially available robotic platform "NAVIO," which was previously supported by I-UK funding, and will obviate the need for percutaneous markers reducing set-up time, cost and complexity during surgery.

Talk to us to see if we can help you

Discuss your AI project with us and lets see if we can help. We can dive into the data you have, the data we can gather from the web and other data sources, how we can manipulate that data for you and how we can output it in a dashboard that your business can actually use.

Our Data Scientists will help you deliver your AI project

Our Data Science experts are recognised globally with over 500+ citations and patents

We have a combined experience of over 40 years in developing cutting edge, and innovative Artificial Intelligence from both academia and industry. We are specialists in Computational Linguistics, Natural Language Processing, Machine Learning, Deep Learning and Data Analytics


Dr Márcia Oliveira,

PhD Network Science


Dr Claudio Sa,

PhD Deep Learning


Dr Catarina Carvalho,

PhD Image Processing