Internal ChatGPT
Customer
Chemicals Company
Created internal instance of ChatGPT that allows employees to benefit from ChatGPT features while ensuring data security and ownership.
Challenge
- Company employees were using the external OpenAI service of ChatGPT
- Client was not able to monitor data that is sent to OpenAI and was risking leaking proprietary data
- Employees could not use ChatGPT’s full capabilities for their daily tasks since they could not use proprietary data
Solution
- Deployment of a secure and reliable AI environment on Azure using Unit8’s Accelerator
- Development of internal ChatGPT that becomes available to company employees via a secured web app
Business Impact
- Employees increase their productivity and satisfaction by using ChatGPT’s full capabilities for their daily tasks
- ChatGPT can be used with proprietary data without the fear or data leakage
- The client can monitor how employees use the internal ChatGPT solution and discover how they can improve their internal processes
Integrating Cognitive Search & OpenAI
Challenges Faced by Medical Practitioners in Acquiring Recent Scientific References on Disease Relationships Amidst Time Constraints
Challenge
- Medical practitioners face constraints in time and capacity when searching for relevant content
- Challenges arise when seeking current scientific references to comprehend the correlation between two diseases
- Hallucination risk: Generative models may inaccurately identify or connect irrelevant information
Solution
- Use of Azure-powered tool and combining Cognitive Search & OpenAI
- Implement fine-tuning model or prompt engineering crucial to minimising hallucination risk
- Test: Experiment with limited data source for nephrology articles
- Putting proper guardrails resulted in no response to out-of-context queries, which was the proper and expected behaviour
Business Impact
- Quickly sifts through vast scientific articles
- Doctors can now find references that potentially contradict the mainstream findings to provide the practitioner with a wider view
- Rapid extraction of insights from unstructured data aids informed decision-making
- A competitive advantage achieved in the respective industry