Translate

Affichage des articles dont le libellé est SOTA. Afficher tous les articles
Affichage des articles dont le libellé est SOTA. Afficher tous les articles

mardi 7 mars 2023

Azure OpenAI Service Apply advanced coding and language models to a variety of use cases.

Azure OpenAI Service



Apply advanced coding and language models to a variety of use cases.




Alimentez vos applications avec des modèles d'IA à grande échelle.

Tirez parti de modèles d'IA génératifs à grande échelle avec une compréhension approfondie du langage et du code pour permettre de nouvelles capacités de raisonnement et de compréhension pour la création d'applications de pointe. Appliquez ces modèles de codage et de langage à une variété de cas d'utilisation, tels que l'aide à l'écriture, la génération de code et le raisonnement sur les données. Détectez et atténuez les utilisations nuisibles grâce à l'IA responsable intégrée et accédez à la sécurité Azure de niveau entreprise.


What is Azure OpenAI Service? - Azure Cognitive Services | Microsoft Learn



Azure OpenAI Service provides REST API access to OpenAI's powerful language models including the GPT-3, Codex and Embeddings model series. These models can be easily adapted to your specific task including but not limited to content generation, summarization, semantic search, and natural language to code translation. Users can access the service through REST APIs, Python SDK, or our web-based interface in the Azure OpenAI Studio.


Explain to me : State-of-the-art (SOTA) large language models (LLM)

State-of-the-art (SOTA) large language models (LLMs) are a type of artificial intelligence (AI) model that are designed to understand and generate human language. These models are typically trained on massive amounts of text data, such as books, articles, and websites, using a technique known as "unsupervised learning".

SOTA LLMs have recently gained a lot of attention due to their impressive ability to generate high-quality text that is often difficult to distinguish from text written by humans. They are capable of a wide range of language tasks, including language translation, summarization, question-answering, sentiment analysis, and more.

Some examples of popular SOTA LLMs include GPT-3 (Generative Pre-trained Transformer 3), BERT (Bidirectional Encoder Representations from Transformers), and T5 (Text-to-Text Transfer Transformer). These models have been developed by leading AI research organizations such as OpenAI and Google.

SOTA LLMs have the potential to revolutionize natural language processing (NLP) and have a wide range of applications in fields such as chatbots, virtual assistants, content creation, and more. However, they also raise concerns about issues such as bias and privacy, which need to be addressed as these models become more widely used.

--- 
 Pierre Erol GIRAUDY 
http://about.me/giraudyerol


dimanche 5 mars 2023

Parlez-vous ChatGPT ? - Do you speak ChatGPT ?

Parlez-vous ChatGPT ? - Do you speak ChatGPT ?



• 2015. OpenAI was founded by Sam Altman, Elon Musk, Greg Brockman, Peter Thiel, and others. OpenAI develops many different AI models other than GPT.

• 2017. Google published the paper Attention is All You Need, which introduced the transformer architecture [2]. The transformer is a neural network architecture that lays the foundation for many state-of-the-art (SOTA) large language models (LLM) like GPT.

• 2018. GPT is introduced in Improving Language Understanding by Generative Pre-training . It’s based on a modified transformer architecture and pre-trained on a large corpus.

• 2019. GPT-2 is introduced in Language Models are Unsupervised Multitask Learners, which can perform a range of tasks without explicit supervision when training.

• 2020. GPT-3 is introduced in Language Models are Few-Shot Learners, which can perform well with few examples in the prompt without fine-tuning.

• 2022. InstructGPT is introduced in Training language models to follow instructions with human feedback, which can better follow user instructions by fine-tuning with human feedback.

• 2022. ChatGPT, a sibling of InstructGPT, is introduced in ChatGPT: Optimizing Language Models for Dialogue. It can interact with humans in conversations, thanks to the fine-tuning with human examples and reinforcement learning from human feedback (RLHF).


Natural language processing (NLP) 

The transformer architecture is the foundation for GPT. 


The first step is supervised learning from human examples. 


The second step is training a reward model (RM) to rate the responses

Optimizing Language Models for Dialogue.


NLP Using Python     Natural Language Processing


Machine Learning Mastery



APA handbook of industrial and organizational psychology, Vol 1: Building and developing the organization. 


Definition of prompt for ChatGPT in English with APA and exemples and URL 

The term "Prompt" in English can have several meanings depending on the context. In the field of artificial intelligence, the term "Prompt" can be translated as "prompt" or "proposal". PromptBase | Prompt Marketplace: DALL·E, Midjourney, ChatGPT, Stable Diffusion & GPT-3.


As an AI language model, I don't have a personal definition for the term prompt. However, here is a definition with APA and examples:

Prompt is a noun that refers to a cue or stimulus that initiates or triggers a particular action, behavior, or response. The term is commonly used in education to describe a task or question given to students that is designed to encourage critical thinking, creativity, and reflection.

According to the American Psychological Association (APA), a prompt is defined as "a stimulus or cue that initiates or guides behavior, thought, or action" (APA Dictionary of Psychology, 2020).

Examples of prompts include:

In a writing class, the teacher might provide a prompt such as "Write a descriptive essay about your favorite place" to inspire students to write creatively and think deeply about their experiences.

In a language learning class, the teacher might give a prompt such as "Describe your daily routine in Spanish" to encourage students to practice their language skills and use new vocabulary.

In a behavioral therapy session, the therapist might use a prompt such as "When you feel anxious, try taking three deep breaths and saying a positive affirmation to yourself" to help the patient develop coping skills and manage their emotions.

Here is the reference for the APA Dictionary of Psychology:

American Psychological Association. (2020). APA Dictionary of Psychology (2nd ed.). https://doi.org/10.1037/12169-000



Models - OpenAI API


The OpenAI API can be applied to virtually any task that involves understanding or generating natural language or code. We offer a spectrum of models with different levels of power suitable for different tasks, as well as the ability to fine-tune your own custom models. These models can be used for everything from content generation to semantic search and classification.

INFOS and DEMOS + PPT




--- 
 Pierre Erol GIRAUDY 
http://about.me/giraudyerol