AI大模型探索之路-实战篇:智能化IT领域搜索引擎的构建与初步实践

07-11 1090阅读

系列篇章💥

No.文章
1AI大模型探索之路-实战篇:智能化IT领域搜索引擎的构建与初步实践
2AI大模型探索之路-实战篇:智能化IT领域搜索引擎之GLM-4大模型技术的实践探索
3AI大模型探索之路-实战篇:智能化IT领域搜索引擎之知乎网站数据获取(初步实践)
4AI大模型探索之路-实战篇:智能化IT领域搜索引擎之知乎网站数据获取(函数封装)
5AI大模型探索之路-实战篇:智能化IT领域搜索引擎之知乎网站数据获取(流程优化)
6AI大模型探索之路-实战篇:智能化IT领域搜索引擎之github网站在线搜索
7AI大模型探索之路-实战篇:智能化IT领域搜索引擎之HuggingFace网站在线搜索

目录

  • 系列篇章💥
  • 前言
  • 一、总体概览
    • 1、需求分析
    • 2、技术方案
    • 二、创建Google Cloud Search API(准备工作)
      • 1、Google Cloud 简介
      • 2、Custom Search API概述
      • 3、GoogleCloud平台注册
      • 4、创建项目
      • 5、启用API
      • 6、获取API密钥
      • 三、创建Google Custom Search Engine(准备工作)
        • 1、可编程的搜索引擎简介
        • 2、创建自己的搜索引擎
        • 3、获取cx、配置环境变量
        • 四、Google自定义搜索引擎使用测试
          • 1、页面搜索测试
          • 2、代码调用测试
          • 结语

            前言

            在信息技术飞速发展的当下,对于专业知识的检索需求正呈现出前所未有的增长态势。为了应对这一挑战,本文将深入探讨如何巧妙地结合大型语言模型的功能调用能力与谷歌搜索引擎API的强大功能,共同打造一个专门针对IT领域的智能在线搜索平台。这个平台不仅能够为用户提供更为精准、高效的搜索结果,还将引领信息技术检索的新潮流,为专业人士带来更加便捷、智能的搜索体验。

            一、总体概览

            1、需求分析

            在构建智能在线搜索平台的过程中,深入的需求分析是至关重要的一步。用户通过输入查询(Prompt)向大型语言模型提出知识性问题,这不仅是用户与系统交互的起点,也是整个搜索流程的核心。当用户提出问题时,我们首先会分析问题的性质和类型,以确定是否需要调用外部搜索引擎进行实时查询。

            接下来,如果大型语言模型内置的知识库能够提供答案,则直接回应用户,这样可以大大缩短响应时间,提高搜索效率。然而,若内置知识库无法提供满意的答案,系统将自动触发外部搜索引擎的调用机制,进行实时查询。这一过程中,我们需要确保系统的自动判断逻辑准确无误,以便在内置知识库无法满足需求时,及时且准确地获取外部信息资源。

            AI大模型探索之路-实战篇:智能化IT领域搜索引擎的构建与初步实践

            2、技术方案

            本项目的技术核心由以下三部分组成:

            1)利用GLM4大模型的函数调用(Funcation Calling)能力,实现智能调度和规划;

            2)使用谷歌搜索引擎提供的API对特定技术平台进行爬取和搜索。

            3)结合提示词Prompt的能力实现实现智能在线搜索。

            AI大模型探索之路-实战篇:智能化IT领域搜索引擎的构建与初步实践

            在技术方案的实施过程中,我们首先利用GLM4大模型的函数调用能力,对用户的查询请求进行智能解析和规划。通过大模型的强大处理能力,我们能够准确理解用户的意图,并快速制定出相应的搜索策略。

            随后,我们使用谷歌搜索引擎提供的API接口,对特定的技术平台进行深度爬取和搜索。谷歌搜索引擎作为全球领先的搜索引擎之一,其强大的搜索能力和海量的数据资源,为我们提供了丰富、准确的搜索结果。

            最后,我们结合提示词Prompt的能力,进一步提升了搜索的智能化水平。通过精心设计的提示词,我们能够引导大模型更加精准地理解用户的搜索需求,并返回更为符合期望的结果。

            二、创建Google Cloud Search API(准备工作)

            1、Google Cloud 简介

            Google Cloud,全称Google Cloud Platform(GCP),是Google提供的一系列云计算服务和API。它允许个人、企业和政府机构在Google的数据中心上运行其应用程序和存储数据。

            2、Custom Search API概述

            Google Cloud上的Custom Search API是Google提供的一项服务,允许开发者将Google的搜索功能集成到自己的应用程序中。这项服务特别适用于需要在特定数据集或网站上提供搜索功能的情况。以下是Custom Search API的一些关键特性:

            • 自定义搜索引擎:用户可以创建一个搜索引擎,只搜索他们选择的网站或网页。
            • 编程访问:通过API,开发者可以以编程方式访问搜索结果,并将它们集成到自己的应用程序中。
            • 搜索结果定制:可以定制搜索结果的显示方式,包括排序、过滤和样式。
            • 搜索范围控制:可以指定搜索的范围,例如只搜索特定的网站或排除某些网站。
            • 安全性选项:包括成人内容过滤等安全搜索选项。
            • 使用限制和计费:Custom Search API可能有使用限制和计费要求,具体取决于使用量和功能。

              3、GoogleCloud平台注册

              登录GoogleCloud平台注册一个账号,有一定的免费额度可以使用;选择一个项目,开始新建项目

              AI大模型探索之路-实战篇:智能化IT领域搜索引擎的构建与初步实践

              4、创建项目

              新增一个项目名称“MyProject001”,地点可以选择无组织

              AI大模型探索之路-实战篇:智能化IT领域搜索引擎的构建与初步实践

              5、启用API

              创建完项目后,启用API和服务(必须启用Custom Search API才能取得凭证)

              AI大模型探索之路-实战篇:智能化IT领域搜索引擎的构建与初步实践

              输入“google search”搜索,找到自定义搜索的API服务

              AI大模型探索之路-实战篇:智能化IT领域搜索引擎的构建与初步实践

              启用自定义搜索的API服务

              AI大模型探索之路-实战篇:智能化IT领域搜索引擎的构建与初步实践

              6、获取API密钥

              创建凭证

              AI大模型探索之路-实战篇:智能化IT领域搜索引擎的构建与初步实践

              创建一个API密钥

              AI大模型探索之路-实战篇:智能化IT领域搜索引擎的构建与初步实践

              配置环境变量

              AI大模型探索之路-实战篇:智能化IT领域搜索引擎的构建与初步实践

              三、创建Google Custom Search Engine(准备工作)

              1、可编程的搜索引擎简介

              地址:https://programmablesearchengine.google.com/

              创建自己专属的搜索引擎。

              Google可编程的搜索引擎通常指的是Google Custom Search Engine(CSE),这是Google提供的一项服务,允许用户创建定制化的搜索引擎。用户可以利用CSE来搜索指定的网站、网页或整个网络。以下是一些关于Google CSE的主要特点:

              1. 定制化搜索:用户可以自定义搜索结果的显示方式,包括搜索框的样式、搜索结果的布局和排序方式。
              2. 控制搜索范围:用户可以指定搜索引擎搜索的特定网站或网页,或者排除某些网站。
              3. 编程接口:Google CSE提供了编程接口(API),允许开发者通过编程方式集成和控制搜索引擎的行为。
              4. 搜索结果过滤:用户可以设置过滤条件,比如只显示某个时间段内的内容,或者排除某些关键词。
              5. 广告选项:Google CSE允许用户在搜索结果中显示广告,并可能从中获得收入。
              6. 易于集成:用户可以将CSE集成到自己的网站或应用程序中,提供无缝的搜索体验。
              7. 搜索结果优化:用户可以对搜索结果进行优化,以提高搜索的相关性和准确性。
              8. 安全搜索:CSE提供了安全搜索选项,可以过滤掉成人内容或其他不适宜的内容。
              9. 使用限制:Google CSE的使用可能受到一定的限制,比如搜索次数限制或特定的使用条款。
              10. 易于管理:用户可以通过Google的控制面板轻松管理自己的CSE。

                Google Custom Search Engine是一个很好的工具,适用于需要在特定内容上提供搜索功能的网站管理员或开发者。通过定制化的搜索引擎,可以提高用户体验并满足特定的搜索需求。

              2、创建自己的搜索引擎

              AI大模型探索之路-实战篇:智能化IT领域搜索引擎的构建与初步实践

              设置搜索引擎信息

              AI大模型探索之路-实战篇:智能化IT领域搜索引擎的构建与初步实践

              3、获取cx、配置环境变量

              取出搜索引擎的信息,主要是里面的cx,也需要配置到本地的环境变量中

              AI大模型探索之路-实战篇:智能化IT领域搜索引擎的构建与初步实践

              四、Google自定义搜索引擎使用测试

              1、页面搜索测试

              通过浏览器页面专用的搜索引擎地址,进行搜索查询测试

              AI大模型探索之路-实战篇:智能化IT领域搜索引擎的构建与初步实践

              2、代码调用测试

              使用Python代码调用Google自定义搜索引擎进行测试:

              import os
              import requests
              from dotenv import load_dotenv
              # 加载环境变量
              load_dotenv()
              # 获取API密钥
              API_KEY = os.getenv("GOOGLE_SEARCH_API_KEY")
              # 获取搜索引擎ID
              CSE_ID = os.getenv("CSE_ID")
              # 定义搜索API的URL
              url = "https://www.googleapis.com/customsearch/v1"
              # 设置查询参数
              query = "AIGC"  # 替换为你的查询词
              params = {
                  "key": API_KEY,
                  "cx": CSE_ID,  # 替换为你的搜索引擎ID
                  "q": query,
                  # 添加其他需要的参数
              }
              # 发送HTTP请求
              response = requests.get(url, params=params)
              # 检查请求是否成功
              if response.status_code == 200:
                  print("请求成功")
                  print(response.json())
              else:
                  print("请求失败")
                  print(response.status_code)
              #打印结果如下
              

              请求成功

              {'kind': 'customsearch#search', 'url': {'type': 'application/json', 'template': 'https://www.googleapis.com/customsearch/v1?q={searchTerms}&num={count?}&start={startIndex?}&lr={language?}&safe={safe?}&cx={cx?}&sort={sort?}&filter={filter?}&gl={gl?}&cr={cr?}&googlehost={googleHost?}&c2coff={disableCnTwTranslation?}&hq={hq?}&hl={hl?}&siteSearch={siteSearch?}&siteSearchFilter={siteSearchFilter?}&exactTerms={exactTerms?}&excludeTerms={excludeTerms?}&linkSite={linkSite?}&orTerms={orTerms?}&dateRestrict={dateRestrict?}&lowRange={lowRange?}&highRange={highRange?}&searchType={searchType}&fileType={fileType?}&rights={rights?}&imgSize={imgSize?}&imgType={imgType?}&imgColorType={imgColorType?}&imgDominantColor={imgDominantColor?}&alt=json'}, 'queries': {'request': [{'title': 'Google Custom Search - AIGC', 'totalResults': '43100000', 'searchTerms': 'AIGC', 'count': 10, 'startIndex': 1, 'inputEncoding': 'utf8', 'outputEncoding': 'utf8', 'safe': 'off', 'cx': '03f7e673e33a64855'}], 'nextPage': [{'title': 'Google Custom Search - AIGC', 'totalResults': '43100000', 'searchTerms': 'AIGC', 'count': 10, 'startIndex': 11, 'inputEncoding': 'utf8', 'outputEncoding': 'utf8', 'safe': 'off', 'cx': '03f7e673e33a64855'}]}, 'context': {'title': 'my-google-search'}, 'searchInformation': {'searchTime': 0.418583, 'formattedSearchTime': '0.42', 'totalResults': '43100000', 'formattedTotalResults': '43,100,000'}, 'items': [{'kind': 'customsearch#result', 'title': 'AI-Generated Content (AIGC): A Survey - NASA/ADS', 'htmlTitle': 'AI-Generated Content (AIGC): A Survey - NASA/ADS', 'link': 'http://ui.adsabs.harvard.edu/abs/2023arXiv230406632W/abstract', 'displayLink': 'ui.adsabs.harvard.edu', 'snippet': 'To address the challenges of digital intelligence in the digital economy, artificial intelligence-generated content (AIGC) has emerged. AIGC uses artificial\xa0...', 'htmlSnippet': 'To address the challenges of digital intelligence in the digital economy, artificial intelligence-generated content (AIGC) has emerged. AIGC uses artificial ...', 'formattedUrl': 'http://ui.adsabs.harvard.edu/abs/2023arXiv230406632W/abstract', 'htmlFormattedUrl': 'http://ui.adsabs.harvard.edu/abs/2023arXiv230406632W/abstract', 'pagemap': {'cse_thumbnail': [{'src': 'https://encrypted-tbn0.gstatic.com/images?q=tbn:ANd9GcQzRxmtHKy5uDa2ltbasgB8sar1Xvpi5uSfmcoID2Rw2NkEdxpWqF8mf9Xt&s', 'width': '240', 'height': '210'}], 'metatags': [{'citation_keywords': 'Computer Science - Artificial Intelligence', 'og:image': 'https://ui.adsabs.harvard.edu/styles/img/transparent_logo.svg', 'citation_publication_date': '03/2023', 'prism.startingpage': 'arXiv:2304.06632', 'theme-color': '#ffffff', 'article:published_time': '03/2023', 'citation_title': 'AI-Generated Content (AIGC): A Survey', 'twitter:card': 'summary_large_image', 'og:site_name': 'NASA/ADS', 'apple-mobile-web-app-title': 'NASA ADS', 'citation_journal_title': 'arXiv e-prints', 'citation_date': '03/2023', 'prism.publicationdate': '03/2023', 'og:description': "To address the challenges of digital intelligence in the digital economy, artificial intelligence-generated content (AIGC) has emerged. AIGC uses artificial intelligence to assist or replace manual content generation by generating content based on user-inputted keywords or requirements. The development of large model algorithms has significantly strengthened the capabilities of AIGC, which makes AIGC products a promising generative tool and adds convenience to our lives. As an upstream technology, AIGC has unlimited potential to support different downstream applications. It is important to analyze AIGC's current capabilities and shortcomings to understand how it can be best utilized in future applications. Therefore, this paper provides an extensive overview of AIGC, covering its definition, essential conditions, cutting-edge capabilities, and advanced features. Moreover, it discusses the benefits of large-scale pre-trained models and the industrial chain of AIGC. Furthermore, the article explores the distinc", 'twitter:creator': '@adsabs', 'citation_arxiv_id': 'arXiv:2304.06632', 'twitter:site': '@adsabs', 'dc.source': 'arXiv', 'citation_language': 'en', 'dc.creator': 'Wu, Jiayang', 'application-name': 'NASA ADS', 'msapplication-tilecolor': '#ffc40d', 'prism.publicationname': 'arXiv', 'og:type': 'eprint', 'twitter:title': 'AI-Generated Content (AIGC): A Survey', 'twitter:domain': 'NASA/ADS', 'og:title': 'AI-Generated Content (AIGC): A Survey', 'citation_abstract_html_url': 'https://ui.adsabs.harvard.edu/abs/2023arXiv230406632W/abstract', 'dc.date': '03/2023', 'article:author': 'Wu, Jiayang', 'citation_authors': 'Wu, Jiayang;Gan, Wensheng;Chen, Zefeng;Wan, Shicheng;Lin, Hong', 'twitter:image:src': 'https://ui.adsabs.harvard.edu/styles/img/transparent_logo.svg', 'citation_firstpage': 'arXiv:2304.06632', 'viewport': 'width=device-width, initial-scale=1, shrink-to-fit=no', 'citation_doi': '10.48550/arXiv.2304.06632', 'twitter:description': "To address the challenges of digital intelligence in the digital economy, artificial intelligence-generated content (AIGC) has emerged. AIGC uses artificial intelligence to assist or replace manual content generation by generating content based on user-inputted keywords or requirements. The development of large model algorithms has significantly strengthened the capabilities of AIGC, which makes AIGC products a promising generative tool and adds convenience to our lives. As an upstream technology, AIGC has unlimited potential to support different downstream applications. It is important to analyze AIGC's current capabilities and shortcomings to understand how it can be best utilized in future applications. Therefore, this paper provides an extensive overview of AIGC, covering its definition, essential conditions, cutting-edge capabilities, and advanced features. Moreover, it discusses the benefits of large-scale pre-trained models and the industrial chain of AIGC. Furthermore, the article explores the distinc", 'dc.title': 'AI-Generated Content (AIGC): A Survey', 'dc.identifier': 'doi:10.48550/arXiv.2304.06632', 'og:url': 'https://ui.adsabs.harvard.edu/abs/2023arXiv230406632W/abstract'}], 'cse_image': [{'src': 'https://ui.adsabs.harvard.edu/styles/img/transparent_logo.svg'}]}}, {'kind': 'customsearch#result', 'title': 'AI-Generated Content (AIGC): A Survey', 'htmlTitle': 'AI-Generated Content (AIGC): A Survey', 'link': 'https://arxiv.org/pdf/2304.06632', 'displayLink': 'arxiv.org', 'snippet': 'Relevant technologies of. AIGC will boost the development of artificial intelligence, better serve human society, and achieve sustainable development. Index\xa0...', 'htmlSnippet': 'Relevant technologies of. AIGC will boost the development of artificial intelligence, better serve human society, and achieve sustainable development. Index ...', 'formattedUrl': 'https://arxiv.org/pdf/2304.06632', 'htmlFormattedUrl': 'https://arxiv.org/pdf/2304.06632', 'pagemap': {'cse_thumbnail': [{'src': 'https://encrypted-tbn0.gstatic.com/images?q=tbn:ANd9GcSYSWDRFJ7CyOEV2u-ZXpE-TpGMIVcjT8wxLlqPFZnZIETekuZBf1bXW4M&s', 'width': '282', 'height': '178'}], 'metatags': [{'moddate': 'D:20230414003603Z', 'creationdate': 'D:20230414003603Z', 'creator': 'LaTeX with hyperref', 'fullbanner': 'This is pdfTeX, Version 3.14159265-2.6-1.40.21 (TeX Live 2020) kpathsea version 6.3.2', 'producer': 'pdfTeX-1.40.21'}], 'cse_image': [{'src': 'x-raw-image:///452d4486d6714c8a17e2815bbdee652289264ec2b4e26ca167124c0dafbbf471'}]}, 'mime': 'application/pdf', 'fileFormat': 'PDF/Adobe Acrobat'}, {'kind': 'customsearch#result', 'title': 'Partnering with our industry to advance AI transparency and literacy ...', 'htmlTitle': 'Partnering with our industry to advance AI transparency and literacy ...', 'link': 'https://newsroom.tiktok.com/en-us/partnering-with-our-industry-to-advance-ai-transparency-and-literacy', 'displayLink': 'newsroom.tiktok.com', 'snippet': "May 9, 2024 ... TikTok is starting to automatically label AI-generated content (AIGC) when it's uploaded from certain other platforms. To do this, we're\xa0...", 'htmlSnippet': 'May 9, 2024 ... TikTok is starting to automatically label AI-generated content (AIGC) when it's uploaded from certain other platforms. To do this, we're ...', 'formattedUrl': 'https://newsroom.tiktok.com/.../partnering-with-our-industry-to-advance-ai...', 'htmlFormattedUrl': 'https://newsroom.tiktok.com/.../partnering-with-our-industry-to-advance-ai...', 'pagemap': {'cse_thumbnail': [{'src': 'https://encrypted-tbn0.gstatic.com/images?q=tbn:ANd9GcSpbhK3GwHiq43ZeruhDQaw9o_xlHJuJq8M0wW3JtUvs6n0neJRn-ab-Oem&s', 'width': '224', 'height': '225'}], 'metatags': [{'og:image': 'https://p16-va-tiktok.ibyteimg.com/obj/musically-maliva-obj/cbb89e4982cec8194aacfde65ca26f83.png', 'renderer': 'webkit', 'article:published_time': '2019-08-16T14:00:00.000Z', 'twitter:card': 'summary_large_image', 'og:image:width': '250', 'og:site_name': 'Newsroom | TikTok', 'apple-mobile-web-app-title': 'TikTok', 'applicable-device': 'pc,mobile', 'pumbaa-ctx': 'cb_enabled=0', 'og:description': "Today, we're sharing updates on our continued efforts to help creators safely and responsibly express their creativity with AI-generated content (AIGC). TikTok is starting to automatically label AI-ge", 'article:publisher': 'https://www.facebook.com/tiktok', 'twitter:image': 'https://p16-va-tiktok.ibyteimg.com/obj/musically-maliva-obj/cbb89e4982cec8194aacfde65ca26f83.png', 'next-head-count': '28', 'twitter:site': '@tiktok', 'article:modified_time': '2019-08-16T14:23:59.000Z', 'og:type': 'article', 'twitter:title': 'Partnering with our industry to advance AI transparency and literacy', 'handheldfriendly': 'true', 'og:title': 'Partnering with our industry to advance AI transparency and literacy', 'og:image:height': '250', 'google': 'notranslate', 'article:tag': 'News', 'apple-mobile-web-app-status-bar-style': 'black', 'viewport': 'width=device-width, initial-scale=1.0, viewport-fit=cover', 'apple-mobile-web-app-capable': 'yes', 'twitter:description': "Today, we're sharing updates on our continued efforts to help creators safely and responsibly express their creativity with AI-generated content (AIGC). TikTok is starting to automatically label AI-ge", 'mobile-web-app-capable': 'yes', 'format-detection': 'telephone=no'}], 'cse_image': [{'src': 'https://p16-va-tiktok.ibyteimg.com/obj/musically-maliva-obj/cbb89e4982cec8194aacfde65ca26f83.png'}]}}, {'kind': 'customsearch#result', 'title': 'AIGC | Wolters Kluwer', 'htmlTitle': 'AIGC | Wolters Kluwer', 'link': 'https://www.wolterskluwer.com/en/solutions/enablon/partners/aigc', 'displayLink': 'www.wolterskluwer.com', 'snippet': "Artificial Intelligence Global Company (AIGC) is a leader in the Middle East's digital transformation, engineering, technology, and consulting space.", 'htmlSnippet': 'Artificial Intelligence Global Company (AIGC) is a leader in the Middle East's digital transformation, engineering, technology, and consulting space.', 'formattedUrl': 'https://www.wolterskluwer.com/en/solutions/enablon/partners/aigc', 'htmlFormattedUrl': 'https://www.wolterskluwer.com/en/solutions/enablon/partners/aigc', 'pagemap': {'cse_thumbnail': [{'src': 'https://encrypted-tbn0.gstatic.com/images?q=tbn:ANd9GcS1SwIR26qyl_GlrGMquMQ8oZFm40yZnw2V4kKB9jgM0evADGcaX1ztKwA&s', 'width': '311', 'height': '162'}], 'metatags': [{'og:image': 'https://assets.contenthub.wolterskluwer.com/api/public/content/dec9c2a7d3994ba3b1935ff920178615?v=d2590547', 'twitter:title': 'AIGC', 'twitter:card': 'summary_large_image', 'viewport': 'width=device-width, initial-scale=1, maximum-scale=5', 'twitter:description': "Artificial Intelligence Global Company (AIGC) is a leader in the Middle East's digital transformation, engineering, technology, and consulting space.", 'og:title': 'AIGC', 'og:url': 'https://www.wolterskluwer.com/en/solutions/enablon/partners/aigc', 'og:description': "Artificial Intelligence Global Company (AIGC) is a leader in the Middle East's digital transformation, engineering, technology, and consulting space.", 'twitter:image': 'https://assets.contenthub.wolterskluwer.com/api/public/content/dec9c2a7d3994ba3b1935ff920178615?v=d2590547'}], 'cse_image': [{'src': 'https://assets.contenthub.wolterskluwer.com/api/public/content/dec9c2a7d3994ba3b1935ff920178615?v=d2590547'}]}}, {'kind': 'customsearch#result', 'title': "AIGC Remover in OnePlus 12's latest update : r/oneplus", 'htmlTitle': 'AIGC Remover in OnePlus 12's latest update : r/oneplus', 'link': 'https://www.reddit.com/r/oneplus/comments/1bv2hmq/aigc_remover_in_oneplus_12s_latest_update/', 'displayLink': 'www.reddit.com', 'snippet': 'Apr 3, 2024 ... 48 votes, 37 comments. 1st picture: Original shot before edit 2nd picture: After using AIGC Remover tool.', 'htmlSnippet': 'Apr 3, 2024 ... 48 votes, 37 comments. 1st picture: Original shot before edit 2nd picture: After using AIGC Remover tool.', 'formattedUrl': 'https://www.reddit.com/r/.../aigc_remover_in_oneplus_12s_latest_update/', 'htmlFormattedUrl': 'https://www.reddit.com/r/.../aigc_remover_in_oneplus_12s_latest_update/', 'pagemap': {'cse_thumbnail': [{'src': 'https://encrypted-tbn0.gstatic.com/images?q=tbn:ANd9GcTbH_OZAeDb864SLeNQ-7OpxlqUFCAblR-HeMfaRBab3ytV93xygrAIuSEn&s', 'width': '194', 'height': '259'}], 'metatags': [{'og:image': 'https://preview.redd.it/aigc-remover-in-oneplus-12s-latest-update-v0-91tfnr6wkbsc1.jpg?width=1080&crop=smart&auto=webp&s=4ac87bbc851581244a4d8877651630186151e713', 'theme-color': '#000000', 'og:image:width': '1080', 'og:type': 'website', 'twitter:card': 'summary_large_image', 'twitter:title': "r/oneplus on Reddit: AIGC Remover in OnePlus 12's latest update", 'og:site_name': 'Reddit', 'og:title': "r/oneplus on Reddit: AIGC Remover in OnePlus 12's latest update", 'og:image:height': '1440', 'msapplication-navbutton-color': '#000000', 'og:description': 'Posted by u/jayv3333 - 48 votes and 37 comments', 'twitter:image': 'https://preview.redd.it/aigc-remover-in-oneplus-12s-latest-update-v0-91tfnr6wkbsc1.jpg?width=1080&crop=smart&auto=webp&s=4ac87bbc851581244a4d8877651630186151e713', 'apple-mobile-web-app-status-bar-style': 'black', 'twitter:site': '@reddit', 'viewport': 'width=device-width, initial-scale=1, viewport-fit=cover', 'apple-mobile-web-app-capable': 'yes', 'og:ttl': '600', 'og:url': 'https://www.reddit.com/r/oneplus/comments/1bv2hmq/aigc_remover_in_oneplus_12s_latest_update/'}], 'cse_image': [{'src': 'https://preview.redd.it/aigc-remover-in-oneplus-12s-latest-update-v0-91tfnr6wkbsc1.jpg?width=1080&crop=smart&auto=webp&s=4ac87bbc851581244a4d8877651630186151e713'}]}}, {'kind': 'customsearch#result', 'title': 'Artificial Intelligence Global Company', 'htmlTitle': 'Artificial Intelligence Global Company', 'link': 'https://www.aigcom.com/', 'displayLink': 'www.aigcom.com', 'snippet': "Artificial Intelligence Global Company are a leading technology and IT services player in the Middle East with top companies' client base across all sectors\xa0...", 'htmlSnippet': 'Artificial Intelligence Global Company are a leading technology and IT services player in the Middle East with top companies' client base across all sectors ...', 'formattedUrl': 'https://www.aigcom.com/', 'htmlFormattedUrl': 'https://www.aigcom.com/', 'pagemap': {'metatags': [{'og:type': 'website', 'twitter:card': 'summary_large_image', 'og:site_name': 'Artificial Intelligence Global Company', 'article:modified_time': '2021-05-11T12:54:49+00:00', 'viewport': 'width=device-width, initial-scale=1.0', 'og:title': 'Home - Artificial Intelligence Global Company', 'og:locale': 'en_US', 'language': 'English', 'og:url': 'https://www.aigcom.com/', 'og:description': "Artificial Intelligence Global Company are a leading technology and IT services player in the Middle East with top companies' client base across all sectors. – RPA – IIoT – Smart City – IR 4.0 Transformation – Robotic & Drones"}]}}, {'kind': 'customsearch#result', 'title': 'No Aigc in OnePlus 12 : r/oneplus', 'htmlTitle': 'No Aigc in OnePlus 12 : r/oneplus', 'link': 'https://www.reddit.com/r/oneplus/comments/1bw7i11/no_aigc_in_oneplus_12/', 'displayLink': 'www.reddit.com', 'snippet': "Apr 5, 2024 ... What's the use of sending an update which promises aigc support but when you try to edit from the photos app there is no option of an ai\xa0...", 'htmlSnippet': 'Apr 5, 2024 ... What's the use of sending an update which promises aigc support but when you try to edit from the photos app there is no option of an ai ...', 'formattedUrl': 'https://www.reddit.com/r/oneplus/comments/.../no_aigc_in_oneplus_12/', 'htmlFormattedUrl': 'https://www.reddit.com/r/oneplus/comments/.../no_aigc_in_oneplus_12/', 'pagemap': {'cse_thumbnail': [{'src': 'https://encrypted-tbn0.gstatic.com/images?q=tbn:ANd9GcQqdgCGt6aySYk9_EkL_T7QkmAIKpWNgJeMVNvyzU_wIy_oc-ZqMETx1hQ&s', 'width': '151', 'height': '333'}], 'metatags': [{'og:image': 'https://external-preview.redd.it/no-aigc-in-oneplus-12-v0-a2lqb2l2Zm11a3NjMeq_1n68FyEnpe2vffHKEchxUlQ-J8tEwI6VQBgGlUg6.png?format=pjpg&auto=webp&s=b098f4fa430584fe2a75ec96d2cf1ccf04afa3d3', 'theme-color': '#000000', 'og:image:width': '1003', 'og:type': 'website', 'twitter:card': 'summary_large_image', 'twitter:title': 'r/oneplus on Reddit: No Aigc in OnePlus 12', 'og:site_name': 'Reddit', 'og:title': 'r/oneplus on Reddit: No Aigc in OnePlus 12', 'og:image:height': '2208', 'msapplication-navbutton-color': '#000000', 'og:description': 'Posted by u/Ares_osiris - 3 votes and 25 comments', 'twitter:image': 'https://external-preview.redd.it/no-aigc-in-oneplus-12-v0-a2lqb2l2Zm11a3NjMeq_1n68FyEnpe2vffHKEchxUlQ-J8tEwI6VQBgGlUg6.png?format=pjpg&auto=webp&s=b098f4fa430584fe2a75ec96d2cf1ccf04afa3d3', 'apple-mobile-web-app-status-bar-style': 'black', 'twitter:site': '@reddit', 'viewport': 'width=device-width, initial-scale=1, viewport-fit=cover', 'apple-mobile-web-app-capable': 'yes', 'og:ttl': '600', 'og:url': 'https://www.reddit.com/r/oneplus/comments/1bw7i11/no_aigc_in_oneplus_12/'}], 'cse_image': [{'src': 'https://external-preview.redd.it/no-aigc-in-oneplus-12-v0-a2lqb2l2Zm11a3NjMeq_1n68FyEnpe2vffHKEchxUlQ-J8tEwI6VQBgGlUg6.png?format=pjpg&auto=webp&s=b098f4fa430584fe2a75ec96d2cf1ccf04afa3d3'}]}}, {'kind': 'customsearch#result', 'title': 'AIGC 2024', 'htmlTitle': 'AIGC 2024', 'link': 'https://icaigc.org/', 'displayLink': 'icaigc.org', 'snippet': 'AIGC 2024 will be a focal point for the latest advancements in AI-generated content. We believe this conference will provide a platform for participants to\xa0...', 'htmlSnippet': 'AIGC 2024 will be a focal point for the latest advancements in AI-generated content. We believe this conference will provide a platform for participants to ...', 'formattedUrl': 'https://icaigc.org/', 'htmlFormattedUrl': 'https://icaigc.org/', 'pagemap': {'cse_thumbnail': [{'src': 'https://encrypted-tbn0.gstatic.com/images?q=tbn:ANd9GcQfvIyB1V1UQQJkxtZp71Jmzrs7mV8MaSrts3fjc7tlZm7qEZlUA4bGTn8&s', 'width': '358', 'height': '141'}], 'metatags': [{'viewport': 'width=device-width, initial-scale=1, maximum-scale=1, user-scalable=no', 'apple-mobile-web-app-capable': 'yes', 'mobile-web-app-capable': 'yes'}], 'cse_image': [{'src': 'https://icaigc.org/images/slider/slider-img1.png'}]}}, {'kind': 'customsearch#result', 'title': 'A Comprehensive Survey of AI-Generated Content (AIGC): A History ...', 'htmlTitle': 'A Comprehensive Survey of AI-Generated Content (AIGC): A History ...', 'link': 'https://newsletter.x-mol.com/paperRedirect/1633924246862884864', 'displayLink': 'newsletter.x-mol.com', 'snippet': 'Mar 7, 2023 ... This survey provides a comprehensive review on the history of generative models, and basic components, recent advances in AIGC from unimodal\xa0...', 'htmlSnippet': 'Mar 7, 2023 ... This survey provides a comprehensive review on the history of generative models, and basic components, recent advances in AIGC from unimodal ...', 'formattedUrl': 'https://newsletter.x-mol.com/paperRedirect/1633924246862884864', 'htmlFormattedUrl': 'https://newsletter.x-mol.com/paperRedirect/1633924246862884864', 'pagemap': {'cse_thumbnail': [{'src': 'https://encrypted-tbn0.gstatic.com/images?q=tbn:ANd9GcTWQt3zdpQl0XLaCOdLPk9609PhbmMEOiFcusRmJjB6Zc9iAR2WjAmrWU0&s', 'width': '294', 'height': '171'}], 'metatags': [{'og:image': 'https://static.arxiv.org/static/browse/0.3.4/images/arxiv-logo-fb.png', 'theme-color': '#ffffff', 'og:image:width': '1200', 'twitter:card': 'summary', 'citation_title': 'A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPT', 'og:site_name': 'arXiv.org', 'citation_date': '2023/03/07', 'og:description': 'Recently, ChatGPT, along with DALL-E-2 and Codex,has been gaining significant\nattention from society. As a result, many individuals have become interested in\nrelated resources and are seeking to uncover the background and secrets behind\nits impressive performance. In fact, ChatGPT and other Generative AI (GAI)\ntechniques belong to the category of Artificial Intelligence Generated Content\n(AIGC), which involves the creation of digital content, such as images, music,\nand natural language, through AI models. The goal of AIGC is to make the\ncontent creation process more efficient and accessible, allowing for the\nproduction of high-quality content at a faster pace. AIGC is achieved by\nextracting and understanding intent information from instructions provided by\nhuman, and generating the content according to its knowledge and the intent\ninformation. In recent years, large-scale models have become increasingly\nimportant in AIGC as they provide better intent extraction and thus, improved\ngeneration results. With the ', 'og:image:secure_url': 'https://static.arxiv.org/static/browse/0.3.4/images/arxiv-logo-fb.png', 'twitter:image': 'https://static.arxiv.org/icons/twitter/arxiv-logo-twitter-square.png', 'citation_arxiv_id': '2303.04226', 'citation_online_date': '2023/03/07', 'twitter:image:alt': 'arXiv logo', 'twitter:site': '@arxiv', 'citation_pdf_url': 'https://arxiv.org/pdf/2303.04226', 'msapplication-tilecolor': '#da532c', 'og:type': 'website', 'og:image:alt': 'arXiv logo', 'twitter:title': 'A Comprehensive Survey of AI-Generated Content (AIGC): A History...', 'og:title': 'A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPT', 'citation_abstract': 'Recently, ChatGPT, along with DALL-E-2 and Codex,has been gaining significant\nattention from society. As a result, many individuals have become interested in\nrelated resources and are seeking to uncover the background and secrets behind\nits impressive performance. In fact, ChatGPT and other Generative AI (GAI)\ntechniques belong to the category of Artificial Intelligence Generated Content\n(AIGC), which involves the creation of digital content, such as images, music,\nand natural language, through AI models. The goal of AIGC is to make the\ncontent creation process more efficient and accessible, allowing for the\nproduction of high-quality content at a faster pace. AIGC is achieved by\nextracting and understanding intent information from instructions provided by\nhuman, and generating the content according to its knowledge and the intent\ninformation. In recent years, large-scale models have become increasingly\nimportant in AIGC as they provide better intent extraction and thus, improved\ngeneration results. With the ', 'og:image:height': '700', 'citation_author': 'Cao, Yihan', 'viewport': 'width=device-width, initial-scale=1', 'twitter:description': 'Recently, ChatGPT, along with DALL-E-2 and Codex,has been gaining significant\nattention from society. As a result, many individuals have become interested in\nrelated resources and are seeking to...', 'og:url': 'https://arxiv.org/abs/2303.04226v1'}], 'cse_image': [{'src': 'https://static.arxiv.org/static/browse/0.3.4/images/arxiv-logo-fb.png'}]}}, {'kind': 'customsearch#result', 'title': 'Robin Guo on X: "The AIGC market map \u200d♂️ Imagine you were ...', 'htmlTitle': 'Robin Guo on X: "The AIGC market map \u200d♂️ Imagine you were ...', 'link': 'https://twitter.com/zebird0/status/1636747294979813379', 'displayLink': 'twitter.com', 'snippet': 'Mar 17, 2023 ... The AIGC market map \u200d♂️ Imagine you were playing DnD. You speak. And the world, monsters, and adventure all get generated in front of you,\xa0...', 'htmlSnippet': 'Mar 17, 2023 ... The AIGC market map \u200d♂️ Imagine you were playing DnD. You speak. And the world, monsters, and adventure all get generated in front of you, ...', 'formattedUrl': 'https://twitter.com/zebird0/status/1636747294979813379', 'htmlFormattedUrl': 'https://twitter.com/zebird0/status/1636747294979813379', 'pagemap': {'cse_thumbnail': [{'src': 'https://encrypted-tbn0.gstatic.com/images?q=tbn:ANd9GcTgh_U_PrxwNHX17QFklrlYvJjWAE8nzedDd3TCW4W-CtPC-FALICRS5LTE&s', 'width': '225', 'height': '225'}], 'imageobject': [{'contenturl': 'https://pbs.twimg.com/media/FrbirhbaQAcWcnt.jpg', 'width': '1024', 'caption': 'Image', 'thumbnailurl': 'https://pbs.twimg.com/media/FrbirhbaQAcWcnt?format=jpg&name=thumb'}], 'person': [{'identifier': '1205328920670855169', 'givenname': 'Robin Guo', 'disambiguatingdescription': 'A16Z GAMES', 'additionalname': 'zebird0'}], 'interactioncounter': [{'userinteractioncount': '8736', 'interactiontype': 'https://schema.org/FollowAction', 'name': 'Likes'}, {'userinteractioncount': '1318', 'interactiontype': 'https://schema.org/SubscribeAction', 'name': 'Retweets'}, {'userinteractioncount': '2018', 'interactiontype': 'https://schema.org/LikeAction', 'name': 'Quotes'}, {'userinteractioncount': '124', 'interactiontype': 'https://schema.org/LikeAction', 'name': 'Likes', 'url': 'https://twitter.com/zebird0/status/1636747294979813379/likes'}, {'userinteractioncount': '21', 'interactiontype': 'https://schema.org/InteractAction', 'name': 'Retweets', 'url': 'https://twitter.com/zebird0/status/1636747294979813379/retweets'}, {'userinteractioncount': '8', 'interactiontype': 'https://schema.org/InteractAction', 'name': 'Quotes', 'url': 'https://twitter.com/zebird0/status/1636747294979813379/retweets/with_comments'}, {'userinteractioncount': '6', 'interactiontype': 'https://schema.org/InteractAction', 'name': 'Replies', 'url': 'https://twitter.com/zebird0/status/1636747294979813379'}], 'metatags': [{'og:image': 'https://pbs.twimg.com/media/FrbirhbaQAcWcnt.jpg:large', 'theme-color': '#FFFFFF', 'og:type': 'article', 'og:site_name': 'X (formerly Twitter)', 'al:ios:app_name': 'X', 'apple-mobile-web-app-title': 'Twitter', 'og:title': 'Robin Guo (@zebird0) on X', 'al:android:package': 'com.twitter.android', 'al:ios:url': 'twitter://status?id=1636747294979813379', 'title': 'Robin Guo (@zebird0) on X', 'og:description': 'The AIGC market map 🧙\u200d♂️\n\nImagine you were playing DnD. You speak. And the world, monsters, and adventure all get generated in front of you, fully rendered, at real time.\n\nAI-powered UGC (AIGC) might make this a reality sooner than we think. @joshlu and I ponder this future below🧵', 'al:ios:app_store_id': '333903271', 'facebook-domain-verification': 'x6sdcc8b5ju3bh8nbm59eswogvg6t1', 'al:android:url': 'twitter://status?id=1636747294979813379', 'fb:app_id': '2231777543', 'apple-mobile-web-app-status-bar-style': 'white', 'viewport': 'width=device-width,initial-scale=1,maximum-scale=1,user-scalable=0,viewport-fit=cover', 'mobile-web-app-capable': 'yes', 'og:url': 'https://twitter.com/zebird0/status/1636747294979813379', 'al:android:app_name': 'X'}], 'collection': [{'name': 'Post with replies'}], 'creativework': [{'name': 'Expanded Tweet URLs', 'url': 'https://t.co/jCtnYMA5CD'}], 'cse_image': [{'src': 'https://pbs.twimg.com/media/FrbirhbaQAcWcnt.jpg:large'}], 'socialmediaposting': [{'identifier': '1636747294979813379', 'commentcount': '6', 'articlebody': 'The AIGC market map 🧙\u200d♂️ Imagine you were playing DnD. You speak. And the world, monsters, and adventure all get generated in front of you, fully rendered, at real time. AI-powered...', 'position': '1', 'datecreated': '2023-03-17T15:12:19.000Z', 'datepublished': '2023-03-17T15:12:19.000Z', 'url': 'https://twitter.com/zebird0/status/1636747294979813379', 'mainentityofpage': 'https://twitter.com/zebird0/status/1636747294979813379'}]}}]}
              

              结语

              通过上述步骤,我们完成了Google自定义搜索引擎相关准备工作;同时成功自定义了一个专属自己的搜索引擎,并实践体验了网页搜索和代码API搜索的两种方式。

              AI大模型探索之路-实战篇:智能化IT领域搜索引擎的构建与初步实践

              🎯🔖更多专栏系列文章:AIGC-AI大模型探索之路

              😎 作者介绍:我是寻道AI小兵,资深程序老猿,从业10年+、互联网系统架构师,目前专注于AIGC的探索。

              📖 技术交流:建立有技术交流群,可以扫码👇 加入社群,500本各类编程书籍、AI教程、AI工具等你领取!

              如果文章内容对您有所触动,别忘了点赞、⭐关注,收藏!加入我,让我们携手同行AI的探索之旅,一起开启智能时代的大门!

VPS购买请点击我

文章版权声明:除非注明,否则均为主机测评原创文章,转载或复制请以超链接形式并注明出处。

目录[+]