Three Steps to Implement Intelligent Automation(Infographic)

While sharing the content, permissions can be given to each user that restricts them from editing, applying different types of filters, and sharing it further. Users can create apps and add specific visuals to create live dashboards that can be accessed through smartphones and tablets. Moreover, one can collaborate with other designers and administrators to work together and create highly customized reports for a particular field.

Challenge

• The IT infrastructure of Atlantis where the Tableau Server platform was hosted was in an on-premise datacenter which was designed to be scalable and robust with multi node physical clusters including the server, storage and network components. However, most of the physical hardware was quite old and not equipped with the latest generation of physical servers.
• Frequent hardware crashes and portal downtime kept troubling the availability of the Tableau Server application. Assigning a touch hand support person to power on the hardware that was down seemed quite impossible due the restrictions during covid period. Hence, Atlantis wanted to look for another viable solution.
• Though the hardware setup at Atlantis was well equipped to meet the occasional spikes in the traffic, it was observed that over a course of 6-month time, most of the IT infra was underutilized than predicted. It was realized that spending huge amount of money on an old hardware plus software maintenance, license costs, internet bandwidth, datacenter cooling and maintenance, touch support personnel and electricity costs – were keeping the business operations challenging.
• There was an attempt by Atlantis to select a cost-effective solution that can host Tableau Server application servers, web servers and archival data. This way IT infra can be re-provisioned to host sensitive data on-premise and the rest on the cloud, thereby reducing the overall physical hardware costs spent on a yearly basis.

Why AWS

• Atlantis decided to migrate Tableau Server, database servers, and archival data to AWS.
• The Tableau Server’s AWS architecture includes Amazon Elastic Compute Cloud (Amazon EC2), that provides complete control of its computing resources, updates to tables in Amazon Relational Database Service (Amazon RDS) and AWS Elastic Load Balancer was used to distribute the traffic to the underlying EC2 instances based on the load.

Benefits

• Atlantis uses AWS services to provision infrastructure and deploy the Tableau Server platform to other departments within it. In addition, the Tableau Server resources that are no longer required to be run all the time are made to auto shutdown thus saving cost. Atlantis reported a 28% cost reduction after implementation of AWS for the Tableau Server platform.
• The implementation of Tableau Server on AWS made Atlantis confident in the security of its data, and its accreditation team is enthusiastic about the monitoring and auditing capabilities provided by AWS tools. With the implementation of IAM roles, Atlantis IT team was able to isolate systems and tightly control user accesses. These capabilities were harder to achieve within the existing infra but were available out of the box with AWS
• By adopting AWS to host the Tableau Server platform, Atlantis has been able to innovate and experiment to a degree previously impossible. For example, Atlantis compared the performance and cost-effectiveness of three different cloud solutions. Without moving to the AWS, the costs associated with running an outdated on-premise hardware would have creeped up and the alternative way of upgrading the existing on-prem infrastructure to the latest hardware models and then hosting the Tableau Server application on top of it would have taken months.

What is Data Governance?

Data governance is the process of managing the availability, usability, integrity, and security of data in an enterprise system. It establishes policies, procedures, and standards for how data is collected, stored, used, and shared. It's about ensuring the right data is available to the right people at the right time, in a secure and compliant manner.

Why Automate Data Governance?

Automating data governance processes brings several benefits, including: • Improved Data Quality: Automation can identify and correct data errors, inconsistencies, and duplicates, leading to improved data quality and more reliable insights. • Increased Efficiency: Automation streamlines data governance processes, reducing manual effort, freeing up valuable time, and accelerating decision-making. • Reduced Costs: Automation helps reduce the costs associated with manual data governance processes, minimizing errors and the need for rework. • Enhanced Compliance: Automation helps ensure compliance with data privacy regulations, such as GDPR, CCPA, and HIPAA, minimizing risk and potential penalties. • Better Decision-Making: By improving data quality and accessibility, automation enables better, more data-driven decision-making. • Scalability: Manual processes struggle to keep up with growing data volumes. Automation allows your governance framework to scale effectively.

How to Automate Data Governance Processes?

Several approaches exist for automating data governance, and often a combination is most effective: • Data Discovery and Classification: Automated tools, like data catalogs, can help discover and classify data based on its content, sensitivity, and other criteria. This is the foundation for understanding your data landscape. • Data Quality Monitoring: Automated tools can continuously monitor data quality, identify potential issues, and trigger alerts for remediation. • Data Lineage Tracking: Automated tools can track the origin and movement of data, providing a clear audit trail and helping to ensure data quality and compliance. This is crucial for understanding how data is transformed and used. • Data Access Control: Automated tools can enforce data access policies, ensuring that only authorized users can access sensitive data, protecting privacy and security. • Data Masking and Anonymization: Automated tools can mask or anonymize sensitive data to protect privacy while still allowing for data analysis and testing. • Metadata Management: Automated tools can capture and manage metadata, providing context and meaning to data assets, making them easier to find and understand.

The Role of Data Catalogs like Alation

Data catalogs play a critical role in automating data governance. They act as a central inventory of all data assets, providing a single source of truth about your data. Modern data catalogs like Alation offer: • Automated Data Discovery and Profiling: Automatically scan and profile data sources to identify and catalog data assets. • Data Lineage: Visually map the journey of data from its origin to its consumption, showing transformations and dependencies. • Data Quality Rules and Monitoring: Define and enforce data quality rules and automatically monitor data for compliance. • Collaboration and Knowledge Sharing: Enable data users to collaborate, share knowledge about data assets, and contribute to data governance efforts. • Search and Discovery: Empower users to easily find the data they need, along with relevant metadata and context.

Best Practices for Automating Data Governance

• Develop a Data Governance Strategy: Before automating, define clear goals, objectives, and metrics for your data governance program. • Identify Key Stakeholders: Engage business users, IT, compliance, and other stakeholders to ensure alignment and buy-in. • Choose the Right Tools: Select tools that meet your specific needs and integrate with your existing data infrastructure. Consider a platform approach that can address multiple aspects of governance. • Implement a Phased Approach: Start with a pilot project to demonstrate value and refine your approach before scaling to the entire organization. • Focus on Data Literacy: Train your employees on data governance policies, procedures, and the use of automated tools. • Monitor and Evaluate: Continuously monitor the effectiveness of your automated data governance processes and make adjustments as needed.

How to Embrace Better Data Governance?

Data governance doesn’t have to be a bottleneck. Organizations can reduce manual workloads, improve compliance, and drive innovation by adopting automation and leveraging tools like data catalogs. Ready to transform your data governance strategy? Get a Free Assessment Now!

What is Generative AI

Generative AI is a subfield of Artificial Intelligence that utilizes patterns found in vast databases to produce original content, including text, images, music, and videos. GenAI aims to provide creative and human-like outputs, in contrast to classical AI, which primarily makes predictions or classifies data. Generative AI models, such as OpenAI's ChatGPT and DALL-E, utilize sophisticated neural networks, specifically transformer architecture, to produce content that is logical and sensitive.

Industries are transforming with the help of generative AI, and its benefits are innumerable. Marketers are using it to automate campaigns and generate personalized content at scale, while writers and creators rely on it to spark ideas and accelerate production. In healthcare, it's being explored for diagnostics, treatment planning, and medical research. At its core, Generative AI isn't just a tool; it's a transformative force reshaping how we create, innovate, and solve complex problems across sectors.

GenAI Solutions in the UAE

The Generative AI market in the UAE is on an impressive growth trajectory. Currently, the market is estimated to have reached USD 220 million and is expected to surpass USD 1.3 billion by 2030, growing at a CAGR of over 35%. With the UAE's commitment to becoming an AI-driven economy, including initiatives such as the UAE National AI Strategy 2031, the region is emerging as a hub for AI adoption and innovation.

Top 10 Benefits of Generative AI

Generative AI is reshaping how businesses create, operate, and innovate. Here are the top ten key benefits of GenAI that you can leverage for your business:

1. Automates Content Creation

Generative AI tools streamline content development, including blog posts, ad copy, social media content, and other types of content. Marketing teams use AI to generate drafts, brainstorm ideas, and iterate quickly. It speeds up production, improves quality through iterative feedback, and reduces the need for hiring additional staff. GenAI tools can craft landing page content or email campaigns that effectively highlight your brand's voice.

2. Delivers Hyper-Personalized Experiences

AI leverages customer and product data to generate personalized recommendations and messaging. In e-commerce, this can mean showing the right product to the right user at the right time. Personalized AI outputs enhance engagement and conversion rates.

To ensure ethical outcomes, businesses are auditing training datasets to prevent bias, which is particularly crucial in sensitive sectors such as healthcare, finance, and hiring.

3. Enhances Product Design and Innovation

AI models analyze market trends and customer behavior to guide product development. By processing vast datasets, they uncover unmet needs and help generate concepts that align with evolving consumer preferences. Many GenAI tools aid in rapid prototyping and idea testing.

4. Strengthens Cybersecurity

Generative AI boosts threat detection by identifying anomalies in network traffic and alerting teams in real time. It excels at identifying phishing patterns, malware signatures, and unusual behaviors more quickly than manual reviews. As attackers also begin using AI, this defense becomes increasingly critical.

5. Accelerates Healthcare Research

Generative AI is expediting drug discovery and diagnostics. AI also allows the generation of synthetic patient data, facilitating preclinical testing without privacy risks. It shortens development timelines and supports personalized medicine by analyzing genetic and clinical datasets. It can also predict diseases before they strike us.

Read Our AI in Healthcare Case Study on Cardiovascular Disease Prevention!

6. Streamlines Business Processes

AI automates repetitive tasks such as summarizing reports, drafting emails, or analyzing PDFs. GenAI Tools allow teams to focus on strategic work rather than data wrangling. For example, HR teams can auto-generate job descriptions, and sales teams can craft personalized follow-up emails using AI.

Book a Free Demo of Our Document Chatbot

7. Improves Customer Support

Generative AI chatbots offer 24/7 support, providing context-aware responses to resolve queries. Unlike traditional bots, these systems adapt in real time, understand tone, and escalate issues when necessary. Businesses utilize various tools to achieve faster resolution times and higher satisfaction scores.

8. Accelerates Market Innovation

By analyzing market signals, customer behavior, and industry shifts, AI uncovers opportunities for product, service, or business model innovation. It reduces risk and helps companies make data-backed decisions about where to invest. AI can forecast trends and simulate outcomes before committing resources, allowing for informed decision-making.

9. Drives Digital Transformation

AI encourages traditional industries, like oil & gas, construction, logistics, and agriculture, to adopt technology by demonstrating clear ROI. Predictive maintenance, supply chain optimization, and workflow automation are just a few areas where AI proves valuable. It helps leaders make faster, more informed decisions, accelerating digital adoption.

10. Accelerates Creative Innovation

Generative AI serves as a brainstorming partner. Designers utilize tools like Midjourney for rapid visual prototyping, while writers and product teams employ chatbots to refine their ideas. These tools provide novel starting points, enabling creators to break through mental blocks and explore new directions more quickly.

Summing Up

Beinex GenAI Solutions is at the forefront of transformation, helping organizations in the UAE explore the full potential of generative AI. As one of the recipients of the Dubai AI seal, Beinex is enabling businesses to innovate faster and operate smarter, from automating content generation to creating intelligent decision-making systems. Businesses that adopt it strategically are gaining a competitive edge, not just by saving time, but by reimagining what's possible.

Explore Beinex GenAI Solutions!

What is an SLM?

A Small Language Model (SLM) is tailored to excel in simpler tasks, offering boosted accessibility and user-friendliness for organizations operating with limited resources. Besides, they can be readily fine-tuned to align with specific requirements. Small language models are particularly well-suited for organizations aiming to develop applications capable of operating local devices instead of relying on cloud infrastructure. They are especially beneficial for tasks that do not necessitate extensive reasoning or immediate responses.

Reasons to use SLMs

Given the growing popularity and applicability of SLMs across various domains, particularly in areas like sustainability and the volume of data required for training, there are multiple reasons for employing them.

From a hardware perspective, utilizing SLMs is more cost-effective, requiring less computational power and memory. Moreover, their suitability for on-premises and on-device deployments enhances security measures.

Regarding usage, SLMs are compact language models, either trained or fine-tuned for specific domains or tasks. Consequently, they can incorporate specialized terminology and knowledge, from legal jargon to medical diagnoses, safeguarding intellectual property. Depending on the context, SLMs offer a more economical and efficient solution.

SLMs find applications across diverse sectors, encompassing healthcare, technology, and beyond. Their utility extends to text summarization, content generation, sentiment analysis, chatbot development, named entity recognition, spell checking, machine translation, and code generation.

What is Phi-3?

Microsoft has a suite of small language models (SLMs) known as 'Phi,' demonstrating outstanding performance across various benchmarks. Microsoft's recent release is Phi-3, a series of open AI models. The Phi-3 models represent a prototype of capability and cost-effectiveness among small language models (SLMs), exceeding models of equivalent and larger sizes across the spectrum of coding, language, reasoning, and mathematical standards. This launch broadens the array of high-calibre models accessible to customers, providing them with more practical options as they craft and construct generative AI applications.

Phi-3-mini, a 3.8B language model, is accessible through Microsoft Azure AI Studio, Hugging Face, and Ollama. It is offered in two context-length variations—4K and 128K tokens. Notably, it is the first model within its category to support a context window of up to 128K tokens with minimal impact on quality. Furthermore, it is instruction-tuned, implying that it has been trained to comprehend and adhere to diverse instructions, mirroring natural human communication patterns. This ensures that the model is readily deployable straight out of the box. Phi-3-mini is available on Azure AI to leverage the deploy-eval-finetune toolchain, and it is also accessible on Ollama for developers to execute locally on their laptops.

Features of Phi-3

Phi-3 models exhibit distinctive superiority over language models of comparable and larger dimensions on key benchmarks, showcasing the following features:

Suitability for resource-constrained environments, including on-device and offline inference scenarios.

Performance optimization for latency-bound scenarios where rapid response times are paramount.

Tailored for use cases with simpler tasks.

Utilization of high-quality training data to ensure model accuracy.

Enhancement through comprehensive safety measures post-training, including reinforcement learning from human feedback (RLHF), automated testing and evaluations across numerous harm categories, and manual red-teaming.

Adherence to the Microsoft Responsible AI Standard, embodying a company-wide adherence to six fundamental principles: accountability, transparency, fairness, reliability and safety, privacy and security, and inclusiveness.

Snowflake meets Phi-3: Advantages  

The key pain point about LLMs is the computing required to host and run them. Setting up a dozen GPUs to run models can be expensive and complex. There's where Snowflake steps up. Snowflake's compute pool option enables users to easily and quickly set up and manage compute clusters. Phi-3 comes into the picture because of its cost-effective GPU utilization.

Can you imagine a situation where your language model only requires less than 3GB of GPU memory for inference? Well, now it's possible, all thanks to Phi-3. It's a state-of-the-art SLM that produces excellent results over GP3.5 and Mistral 8x7B, which are much bigger models. This opens the door for more cost-effective solutions to be brought up in the AI space. Add Snowflake for hosting; you have an excellent setup to host, test, and build AI applications. Read below how Beinex managed to run Phi-3 on Day 0 in Snowflake.  Figure 1: DocAI running on Phi-3

Implementing Phi-3 on Snowflake: What Beinex Did and How Beinex Did it?

Beinex has seamlessly integrated Phi-3 into Snowflake to help enterprises unlock their data's full potential through advanced language processing capabilities and enhance decision-making with deeper insights. The integration facilitates Snowflake users to:

Capitalize on the efficiency of Phi-3 in environments with limited resources.

Ensure swift responses to queries and data requests, improving operational efficiency.

Achieve cost savings without compromising on model performance, optimizing resource allocation.

Boost the precision and dependability of their data-driven insights and predictions.

Leverage state-of-the-art AI capabilities while strictly adhering to data governance and compliance standards.

Here's a detailed guide on implementing Phi-3 on Snowflake:
Step 1: Create Necessary Objects  -- Run by ACCOUNTADMIN to allow connecting to Hugging Face to download the model  -- Stage to store LLM models  CREATE STAGE <stagename> IF NOT EXISTS models  DIRECTORY = (ENABLE = TRUE)  ENCRYPTION = (TYPE='SNOWFLAKE_SSE');    -- Stage to store YAML specs  CREATE STAGE <stagename> IF NOT EXISTS specs  DIRECTORY = (ENABLE = TRUE)  ENCRYPTION = (TYPE='SNOWFLAKE_SSE');    -- Image repository  CREATE OR REPLACE IMAGE REPOSITORY images;    -- Compute pool to run containers  CREATE COMPUTE POOL GPU_NV_S    MIN_NODES = 1    MAX_NODES = 1    INSTANCE_FAMILY = GPU_NV_S;  Step 2: Docker Image Code - ollama  FROM ollama/ollama    RUN $(ollama serve > output.log 2>&1 &) && sleep 10 && ollama pull phi3 && pkill ollama && rm output.log    ENTRYPOINT ["ollama"]  CMD ["serve"]  Step 3: Tag and Push the Docker Image  docker tag ollama <SNOW_ORG-SNOW_ACCOUNT>.registry.snowflakecomputing.com/db/schema/image respository /ollama  docker push <SNOW_ORG-SNOW_ACCOUNT>.registry.snowflakecomputing.com db/schema/image repository /ollama  Step 4: Docker Image - UDF  FROM python:3.11    WORKDIR /app  ADD ./requirements.txt /app/    RUN pip install --no-cache-dir -r requirements.txt    ADD ./ /app    EXPOSE 5000    ENV FLASK_APP=app  CMD ["flask", "run", "--host=0.0.0.0"]  App.py content is given below :  from flask import Flask, request, Response, jsonify  import logging  import re  import os  from openai import OpenAI    client = OpenAI(      base_url='http://ollama:11434/v1',      api_key="EMPTY",  )    model = "phi3"    app = Flask(__name__)  app.logger.setLevel(logging.ERROR)      def extract_json_from_string(s):      logging.info(f"Extracting JSON from string: {s}")      # Use a regular expression to find a JSON-like string      matches = re.findall(r"\{[^{}]*\}", s)        if matches:          # Return the first match (assuming there's only one JSON object embedded)          return matches[0]        # Return the original string if no JSON object is found      return s      @app.route("/", methods=["POST"])  def udf():      try:          request_data: dict = request.get_json(force=True)  # type: ignore          return_data = []            for index, col1 in request_data["data"]:              completion = client.chat.completions.create(                  model=model,                  messages=[                      {                          "role": "system",                          "content": "You are a bot to help extract data and should give professional responses",                      },                      {"role": "user", "content": col1},                  ],              )              return_data.append(                  [index, extract_json_from_string(completion.choices[0].message.content)]              )            return jsonify({"data": return_data})      except Exception as e:          app.logger.exception(e)          return jsonify(str(e)), 500  Step 6: YAML File  spec:    containers:      - name: ollama        image: <SNOW_ORG-SNOW_ACCOUNT>.registry.snowflakecomputing.com/ db/schema/image respository /Phi3        resources:          requests:            nvidia.com/gpu: 1          limits:            nvidia.com/gpu: 1        env:          NUM_GPU: 1          MAX_GPU_MEMORY: 24Gib        volumeMounts:          - name: llm-workspace            mountPath: /<stage name>      - name: udf        image: <SNOW_ORG-SNOW_ACCOUNT>.registry.snowflakecomputing.com/ db/schema/image respository /ollama_udf    endpoints:      - name: chat        port: 5000        public: false      - name: llm        port: 11434        public: false    volumes:      - name: llm-workspace        source:  "@<llm stage_name>"  Step 7: Upload YAML File and Create Service  Upload the YAML file to the created stage, where the stage name in the YAML file should match the stage created in Step 2.  -- Create service  create service phi3  IN COMPUTE POOL <name of compute pool created>  FROM @dash_stage  SPECIFICATION_FILE = '<name of yaml file uploaded>';  Step 8: Create Service Function  Create a service function on the service (after it starts).  create or replace function phi3chat(prompt text)  returns text  service= phi3  endpoint=chat;  Check Service Status  Use the following command to check the status of the service:  SELECT     v.value:containerName::varchar container_name,    v.value:status::varchar status,    v.value:message::varchar message  FROM (    SELECT parse_json(system$get_service_status('<service name>'))  ) t,   LATERAL FLATTEN(input => t.$1) v; 

Benefits of Running Phi-3 on Snowflake

1. Cost-Effectiveness and Efficiency:

Phi-3's efficacy as a model, coupled with Snowflake's cloud-based infrastructure, ensures cost-effective operations.

Running Phi-3 on Snowflake minimizes operational expenses by optimizing resources and maximizing performance while delivering exceptional results.

2. Compatibility with Smaller GPUs:

Phi-3's versatility allows it to run efficiently on smaller GPUs, making it accessible to a wider range of users.

This flexibility enables organizations to leverage existing hardware infrastructure without needing extensive upgrades.

3. Exceptional Performance:

Despite being an SLM, Phi-3 outperforms both SLMs and Large Language Models (LLMs) available in the market.

This superior performance translates to more accurate and reliable user outcomes, enhancing productivity and decision-making.

4. Faster Response Times:

Even in resource-constrained environments, Phi-3's capability to deliver faster responses is particularly advantageous within Snowflake's ecosystem.

This integration ensures swift data processing and analysis by minimizing latency and maximizing throughput, enabling users to make informed real-time decisions.

SLM vs LLM

The choice between small and large language models hinges on organizational needs, task complexity, and resource availability.

LLMs excel in applications requiring the orchestration of intricate tasks, encompassing advanced reasoning, data analysis, and contextual comprehension.

On the other hand, SLMs present viable options for regulated industries and sectors facing scenarios necessitating top-tier results while maintaining data within their premises.

Both large and small language models possess distinct strengths and applications. While large language models thrive in managing complex workflows, small language models deliver impressive performance despite their compact size.

While some customers may exclusively require small models, others may favour larger models, with many seeking to integrate both types in various configurations. Ultimately, the optimal selection depends on the unique context and objectives of the organization. Besides transitioning from large to small models, the trend is evolving towards a diversified portfolio of models. This means that instead of relying on a single model, customers can choose from various models with different sizes, capabilities, and resource requirements. This empowers customers to decide the best model for their scenario, balancing performance and resource constraints.