Integrating Cognitive Search & OpenAI
Challenges Faced by Medical Practitioners in Acquiring Recent Scientific References on Disease Relationships Amidst Time Constraints
Challenge
- Medical practitioners face constraints in time and capacity when searching for relevant content
- Challenges arise when seeking current scientific references to comprehend the correlation between two diseases
- Hallucination risk: Generative models may inaccurately identify or connect irrelevant information
Solution
- Use of Azure-powered tool and combining Cognitive Search & OpenAI
- Implement fine-tuning model or prompt engineering crucial to minimising hallucination risk
- Test: Experiment with limited data source for nephrology articles
- Putting proper guardrails resulted in no response to out-of-context queries, which was the proper and expected behaviour
Business Impact
- Quickly sifts through vast scientific articles
- Doctors can now find references that potentially contradict the mainstream findings to provide the practitioner with a wider view
- Rapid extraction of insights from unstructured data aids informed decision-making
- A competitive advantage achieved in the respective industry
Internal ChatGPT
Customer
Chemicals Company
Created internal instance of ChatGPT that allows employees to benefit from ChatGPT features while ensuring data security and ownership.
Challenge
- Company employees were using the external OpenAI service of ChatGPT
- Client was not able to monitor data that is sent to OpenAI and was risking leaking proprietary data
- Employees could not use ChatGPT’s full capabilities for their daily tasks since they could not use proprietary data
Solution
- Deployment of a secure and reliable AI environment on Azure using Unit8’s Accelerator
- Development of internal ChatGPT that becomes available to company employees via a secured web app
Business Impact
- Employees increase their productivity and satisfaction by using ChatGPT’s full capabilities for their daily tasks
- ChatGPT can be used with proprietary data without the fear or data leakage
- The client can monitor how employees use the internal ChatGPT solution and discover how they can improve their internal processes
