Businesses are increasingly exploring the practical use cases of GenAI to drive efficiency, innovation, and personalized customer experiences. Surya Prabha Vadlamani, VP of Enterprise AI Solutions and Cognitive Engineering for Centific, is helping them succeed.

She and her team have extensive experience building a wide variety of AI solutions across different domains as they support the Centific frontier AI data foundry platform.

Prabha shared some lessons from the front lines of GenAI in a conversation with Peter Schultz, Director of Business Development at Centific. They discuss the importance of implementing GenAI use cases thoughtfully, balancing ethical considerations with real-world business needs, and the benefit of relying on a high-quality frontier AI data foundry platform to maximize the potential of AI solutions.

The following is a transcript of highlights from that conversation.

Safe AI is a business imperative

Peter: These days, it feels like you can’t talk about GenAI without somebody bringing up the many ethical considerations and how to manage them. From your technical standpoint, Prabha, why is safe AI so crucial in today’s business environment?

Prabha: My team operates on the principle that safety, high-quality data, and ethics are inseparable from GenAI.

As a frontier AI data foundry, through our platform, we enhance trust and reliability—two crucial components of effective GenAI systems.

Whenever we talk about removing hallucinations or ensuring AI behaves in predictable, safe ways, essentially, we are focusing on building trust between these systems and the people who use them.

Peter: Trust in your tools is very important, but it can be hard to come by.

Prabha: For businesses, this means that—when working with GenAI applications—you need to prioritize not just efficiency and performance but also alignment with society’s ethical standards and values. You also need to demonstrate that alignment, not only to state it.

Integrate GenAI where it adds tangible value

Peter: So, the ideal deployment, then, isn’t just about bringing solutions to market as fast as possible but doing so as fast, quickly, and safely as possible. How does a business make sure it’s using GenAI to solve real business problems and not using GenAI just to use GenAI?

Prabha: The goal is to integrate GenAI where it adds tangible value. Our frontier AI data foundry platform uses high-quality, curated data to help ensure precision. For example, enabling employees to find information faster or automating complex processes through well-tuned AI models provides tangible value.

We recommend that your business starts by identifying pain points and then seeing if GenAI offers the most effective solution. Sometimes, it doesn’t.

This approach not only saves time but also significantly boosts productivity by streamlining SOPs, inventory management, and even customer engagement through use cases like data-driven personalization.

Apply GenAI uses cases to improve customer engagement

Peter: Speaking of customer engagement, that’s kind of a buzzword phrase in GenAI right now. Could you give us a practical example of what that might look like?

Prabha: Absolutely. Consider the power of GenAI in understanding data and using that data to render predictions about customer behaviors. By analyzing past interactions and preferences, GenAI can actually offer personalized product recommendations, or next best product suggestions, tailored to the specific shopping habits of each individual customer.

It is about creating a more intuitive and satisfying shopping experience by anticipating the customer’s needs and offering solutions even before they have to ask for them.

Peter: So, the strategic application of GenAI for predictive personalization not only bolsters efficiency but fundamentally transforms the customer journey?

Prabha: Yes, using machine precision to create more-human touchpoints. GenAI has the potential to deeply personalize and enhance any customer experience.

Align GenAI solutions with business goals

Peter: For businesses looking to adopt GenAI solutions like what you just described, what’s the first step in determining if they actually have a realistic business case?

Prabha: The first step is to conduct a thorough needs analysis. Understand the challenges and inefficiencies in your current operations and identify areas where automation or AI-driven insights could introduce improvements.

From there, it is about assessing the feasibility and the potential ROI of implementing GenAI solutions, keeping in mind the ethical considerations we talked about earlier.

Next comes model evaluation, fine-tuning, and adopting a frontier AI data foundry platform to streamline red-teaming, localization, and benchmarking. This helps ensure that the AI solution is not only safe and high-quality but also accelerates deployment into the market.

Invest in robust quality assurance programs

Peter: With all that going on, I’d imagine you’d have to have quite a robust quality assurance program in place, right?

Prabha: Yes. This is where benchmarking applies. Benchmarking is the process of systematically measuring and comparing the performance of your AI solutions against established standards or other systems.

Especially when you are building GenAI applications with RAG capabilities on top of foundational LLMs, a good benchmarking framework determines whether or not you are actually going to be able to find value in that application. It is that important.

Peter: Could you talk a little more about RAG for those who might not know what it is?

Parbha: RAG is retrieval-augmented generation and—let me first say that a foundational LLM is already very powerful, typically trained on very large datasets and capable of understanding and generating human-like text.

Integrate a foundational model with a RAG system and you essentially teach the LLM how to fetch external information and how to do so quickly.

Now, that is important because it means your GenAI application does not just rely on its training data and that it can actually pull in the most relevant and current information when generating outputs. Think of an LLM that can search Google for news, scientific research, or even employee social media posts.

Peter: It supercharges the output. That sounds like every LLM user’s fantasy.

Prabha: Precisely, yes. So, when benchmarking these systems, we look at metrics like the accuracy of the information retrieved, the relevance of the generated text, and also the speed at which all of this happens. These metrics tell us how well the RAG system is performing and where it might need adjustments.

Customize GenAI to meet your goals

Peter: How do you make sure these enhancements align with a business’s practical goals?

Prabha: Great question. Every step of the benchmarking process—from choosing the foundational model to designing the RAG component, even to iterative refinement—must be aligned with your business’s objectives.

If your business needs an AI solution for customer service, for example, benchmarking that might mean focusing on the system’s ability to provide accurate, fast, and precise answers to customer inquiries.

If it is for content creation, the focus might be on creativity and adherence to the creative brief, brand style, voice, tone, and so on.

Peter: It sounds like there’s a lot of customization involved.

Prabha: There certainly should be. That level of adaptability is part of the beauty of these solutions. With clear goals and a solid foundation of high-quality data, continuous fine-tuning and benchmarking can help ensure your system does what it needs to do in the right ways, at the right time, and so on.

But, this also means you will need clear goals and a more thorough understanding of your needs. Identifying and understanding those needs can sometimes be more of a challenge than actually solving them.

Apply GenAI use cases to improve your business

Peter: It’s clear that the thoughtful and purposeful application of GenAI use cases has the potential to revolutionize business processes and customer interactions. But, it can often seem like there are many requirements, to many almost, for businesses to actually put GenAI to work. How can larger enterprises scale GenAI solutions more cost-effectively, without sacrificing real ROI?

Prabha: Scaling GenAI solutions begins with identifying core areas of impact within your business processes. The key is to start small with pilot projects that address specific issues or opportunities. This allows for the measurement of ROI in a controlled environment.

As these projects prove their value, scaling up involves modular and reusable AI components, which can be adapted and expanded across different use cases. This approach not only proves to be cost-effective but also accelerates the integration of your GenAI solutions into larger ecosystems.

Peter: That’s one strategic approach. Now, in terms of building and deploying these solutions, transparency is often cited as a significant concern, preventing many enterprises from even considering GenAI adoption. What would you say to companies looking to both ensure transparency and comply with regulations while using tools like large language models?

Prabha: Transparency in AI is crucial, both for trust and compliance. This involves clear documentation of the selected AI models, their decision-making processes, and the datasets used for training. Explainability is a key part of this. Implementing explainable AI practices helps demystify the AI’s decisions for end users and regulators alike.

If your business is global, it is also important to stay up to date and comply with international AI standards. This can be done by incorporating AI governance frameworks from the very beginning.

In many cases, because of this, we recommend that you use private LLMs, not public or open source. The latter might be less secure or use your proprietary data to train your competitors’ models.

Deliver value with private data for GenAI use cases

Peter: What’s the difference between a public and private model, and how do you go about building one?

Prabha: Essentially, a public model is one that is available to everybody and shared across organizations, whereas a private model is developed specifically for one organization and tailored to its unique requirements and data.

To build a private LLM, you need to fine-tune your foundational model with specific data and train it to function under new rules. That allows the model to adapt its responses to the desired nuances and details of your organization’s language usage and needs.

The first step is to gather a dataset with the linguistic characteristics, terminology, and types of interactions that are most relevant to your use case. That could be emails, manuals, customer service transcripts—anything. It’s best to use a frontier AI data foundry like Centific’s to curate or synthesize that data, as much of it could otherwise be prohibitively cost-effective or challenging to source.

With that specialized dataset, we proceed to fine-tune the model. This means we continue the training process where the pre-trained—that is, foundational—model left off, but now we use your proprietary data to make the model’s responses more aligned with your specific requirements.

Naturally, it is important to rigorously test the model to make sure it performs well on whatever tasks you expect it to encounter in its workload. For that, we look at metrics like accuracy, relevance, and how well the model handles edge cases. You will notice this is maybe a little similar to how you might evaluate a human trainee.

The last step, if you will—or maybe “phase” is more accurate. The last phase once the model is production-ready is to deploy it to your systems and integrate it into the workstream. But you don’t want to just “fire and forget;” you will want to keep monitoring and improving it over time.

Apply rigorous governance policies to GenAI

Peter: Let’s go back for a moment to something you said earlier about protecting data and IP [intellectual property]. The cost of a data breach is something like $6 million, and I’m wondering, how can businesses apply GenAI while reducing that kind of risk?

Prabha: Of course, data and IP protection start with robust data governance policies. When it comes to GenAI, employing techniques like federated learning can help protect sensitive information by training algorithms across decentralized devices or servers without actually sharing the data.

Businesses handling sensitive data should invest in private AI models within secure architectures that ensure data integrity and confidentiality, alongside regular audits to assess the security of their GenAI solutions.

Learn from GenAI use cases

Peter: Of course, these are some of the more foundational aspects for any business looking to adopt GenAI. But, could you give us more examples across a broader range of GenAI use cases, maybe something more specialized?

Prabha: Yes. Beyond internal efficiencies, GenAI has the potential to improve customer service through deployments of chatbots and virtual assistants that provide timely and personalized responses.

In manufacturing, many businesses are already using AI for tasks like predictive maintenance. After upgrading AI-driven computer vision systems with GenAI, users can talk to those AI tools in natural language, removing a major barrier to entry, which is the requirement for deep technical or coding expertise.

In marketing, AI can analyze vast amounts of data to identify trends and preferences, and GenAI can produce natural-language recommendations for how to turn those insights into targeted campaigns that resonate with specific audiences.

And, of course, this is only the beginning. As research into multimodal GenAI progresses, this technology is quickly gaining the potential to drive business value across virtually any domain or use case.

Peter: It’s fascinating to see the sheer breadth of applications for GenAI in business. As engineers like you continue to explore and innovate within these technologies, what do you think will be a few key considerations crucial for success?

Prabha: So, the journey with GenAI is about strategic implementation, grounded in ethical use, transparency, and protection of critical assets. By focusing on these points, businesses better prepare themselves to drive innovation and growth with GenAI.

Innovation and partnerships fuel GenAI success

Peter: Let’s pivot to the pace of innovation and the role of partnerships for managing that pace. The field of GenAI is advancing rapidly, with new developments coming out seemingly by the minute. How can businesses keep up with this break-neck pace?

Prabha: Right, so the pace of GenAI evolution is definitely fast.

Peter: Some pretty high-profile people say things are moving too fast.

Prabha: But, with responsible AI safeguards in place, safety becomes actually less of a challenge than the logistics of adapting to change.

Keeping up with the newest technology requires adopting a mindset of continuous learning and adaptation. That means staying informed about the latest developments and understanding how they can impact or improve current operations.

Fostering a culture of innovation within your organization, for example, is crucial for encouraging experimentation among engineers and ensuring that they’re not afraid to fail. Failure is just a part of the process.

Peter: Of course, not every business has the time or, more importantly, the trained staff to devote to that kind of experimentation. With that in mind, what’s the role of the GenAI enablement partner in the current business environment?

Prabha: It’s a very important role. Partnerships do more than just help businesses stay safe or keep up with change. They help your business lead that change.

Partnerships provide businesses with access to specialized knowledge and technologies that may not be available in-house. With a lack of available talent currently affecting the workforce, access to out-of-house expertise can be crucial.

The right partner with the right expertise can shorten the GenAI adoption timeline from years to months. Such a partner would help to combine human expertise with a strong frontier AI data foundry platform to maximize efficiency in managing high-quality data.

For instance, the Centific network of domain-certified subject matter experts substantially accelerates the timeline of development, localization, and contextualization of high-quality GenAI applications safely, quickly, and affordably—especially more so than [some of Centific’s competitors].

Technology partners can actually act as an extended center of excellence, helping businesses not just in the implementation phase but throughout the entire lifecycle of GenAI solutions. Examples include ongoing support, updates, continuous improvement based on the latest innovations, and more.

Identify a realistic GenAI use case

Peter: Speaking of adoption, you mentioned earlier that, before all that, businesses need to identify whether they even have a realistic case for GenAI in the first place. Let’s go back and end on another quick chat about that.

Prabha: Sure. So, identifying a realistic business case starts with understanding the problems you’re trying to solve or the opportunities you wish to participate in. This involves a deep dive into your current processes, identifying inefficiencies, or areas where customer experiences could be improved, and so on.

From there, it is just about evaluating how GenAI can address those needs and what kind of GenAI investment is required. There are many different kinds of models, applications, and frameworks to choose from.

And, of course, your business should also consider the ethical implications to ensure its technology investments align with its core values and with the expectations of its customers.

Peter: After all, the comprehensive approach is the best approach.

Prabha: Right.

Peter: Prabha, any final thoughts on the future of GenAI in business?

Prabha: It is incredibly bright. But to navigate it will require a great deal of expertise and trained talent.

Ethical considerations, practical applications, and innovation must go hand in hand. Businesses that manage to balance these elements, especially with the help of strong partnerships, will not only thrive but also lead the way in their respective industries.

Truly, the journey with GenAI is just beginning.

Peter: And I for one am excited to see where it takes us. Thank you, Prabha, for sharing your insights and expertise. It’s been an enlightening conversation, and I’m sure the rest of the team here has gained a lot of valuable information about practical GenAI just from this one brief chat.

Prabha: And thank you.

Learn more about Centific’s frontier AI data foundry platform.