RESEARCH QUESTION
Hello Feature researchscholar.cloud in Google's Search Index so it can show up in Google search results! Submit researchscholar.cloud now: domainsubmit.pro
Oct 2, 2026 · 15:06 PARTIAL
30-SECOND VIEW
Final Research Answer
Read full answer
Executive summary
This review synthesizes evidence on search engine indexing and domain submission for academic repositories. Key findings indicate that search engine optimization (SEO) is critical for visibility, with backlinks, metadata quality, and technical factors being major ranking determinants. However, institutional repositories demonstrate low real-world visibility in Google Search despite open access, suggesting inefficiencies in current academic indexing practices. While tools like Google Search Console are widely recommended for monitoring and improvement, no direct evidence evaluates automated domain submission services. Significant research gaps exist regarding third-party submission efficacy and comparative indexing pathways. Methodological limitations include sparse empirical studies on academic domains and limited geographic scope. Future research should prioritize controlled evaluations of submission tools and large-scale academic repository optimization studies.
Partial research available
Planner 2 — Llama 4 Scout: OpenRouter rate-limited this request. Please try again later. Retry
semantic_scholar: Semantic Scholar retrieval failed (rate_limit). Retry
2-MINUTE VIEW
Key Findings
SEO significantly influences Google rankings
Support diagnostic: academically supported
View sources
SEO significantly influences Google rankings
Analysis of 256,853 search results [C483] shows most top-ranked pages exhibit optimization patterns. Without SEO techniques, visibility remains limited.
[C483] The influence of search engine optimization on Google's results: A multi-dimensional approach for detecting SEO Open source
Institutional repositories generate minimal organic traffic
Support diagnostic: academically supported
View sources
Institutional repositories generate minimal organic traffic
Empirical Spanish study [C482] found only narrow content segments (e.g., humanities theses) achieved visibility, with limited overall user traffic via Google Search.
[C482] Open access publications drive few visits from Google Search results to institutional repositories Open source
Backlinks and content structure are primary ranking factors
Support diagnostic: academically supported
View sources
Backlinks and content structure are primary ranking factors
Systematic assessment [C486] confirmed backlink quantity/quality, title tag keywords, and site architecture as consistently significant correlates of Google rankings across test queries.
[C486] Important Factors for Improving Google Search Rank Open source
Google Search Console enables SEO diagnostics
Support diagnostic: academically supported
View sources
Google Search Console enables SEO diagnostics
Descriptive analyses [C481, C485] propose Google Search Console as essential for identifying indexing issues, though no controlled studies measure implementation effects.
[C481] INCREASE WEBSITE VISIBILITY ON THE INTERNET BY GOOGLE SEARCH CONSOLE Open source
[C485] Maximizing Online Visibility, the Importance of Search Engine Optimization on Google Open source
Evidence Overview
8 valid sources · 0 conflicting findings · 1 disagreements · 22 papers reviewed
The metrics above describe saved evidence. Source associations and agreement between models are not independent verification.
Best Academic Evidence
Saved synthesis ranking where available; otherwise Consensus order. Retrieved papers are not automatically proof of a claim.
ConsensusINCREASE WEBSITE VISIBILITY ON THE INTERNET BY GOOGLE SEARCH CONSOLE
O. Sakaliuk, O. Shershun · 2023 · Automation of technological and business processes
The article "Increase Website Visibility On The Internet By Google Search Console" is devoted to the consideration of the importance and use of Google Search Console for website optimisation and improvement of its visibility in search engines. The article discusses the main aspects of search engine…
Read paper details
O. Sakaliuk, O. Shershun
The article "Increase Website Visibility On The Internet By Google Search Console" is devoted to the consideration of the importance and use of Google Search Console for website optimisation and improvement of its visibility in search engines. The article discusses the main aspects of search engine optimisation, as well as the role of Google Search Console as a powerful tool for analysing, monitoring and improving SEO strategy. The article describes methods of integrating Google Search Console with Google Analytics to obtain more detailed information about traffic, keywords, CTR and other important metrics. The article emphasises that using Google Search Console allows you to identify technical issues, analyse content, monitor website health, and perform competitive analysis to achieve better results in search results. Thanks to these insights, website owners and marketers can develop an effective strategy to increase the visibility of their site and attract a larger audience of users. Website indexing is an important part of the search engine optimisation process and is essential for increasing the visibility and accessibility of a website on the Internet. Indexing allows search engines such as Google, Bing, Yahoo, and others to find, analyse, and index the pages of a website. This allows search engines to include the site in their search results, which ensures its visibility to potential visitors. Indexing can help you drive more organic traffic to your website. When pages of a website are indexed, they can appear in search results when users make relevant requests. This opens up the possibility of attracting new visitors who are looking for relevant information or products and services. Indexing allows search engines to analyse website content, including keywords, meta tags, URLs, and other elements. This is important for SEO because this data affects the ranking of a website in search results. The better a website is indexed, the more chances it has to reach the top positions in search results and attract the target audience. During indexing, search engines can detect technical issues such as page errors, broken links, or duplicate content. This allows you to quickly identify and fix issues that could negatively affect your site's visibility and rankings. Using tools such as Google Search Console, you can track and analyse your site's indexing data. You can see which pages are being indexed, which get the most traffic, which keywords attract the attention of search engines, and much more. This information helps you understand how your site performs in search engines and how you can improve its visibility.
DOI: 10.15673/atbp.v15i2.2516
Open source ↗Open access publications drive few visits from Google Search results to institutional repositories
E. Orduña-Malea, Cristina I. Font-Julián, Jorge Serrano-Cobos · 2024 · Scientometrics
Given the importance of Google Search in generating visits to institutional repositories (IR), a lack of visibility in search engine results pages can hinder the possibility of their publications being found, read, downloaded, and, eventually, cited. To address this, institutions need to evaluate t…
Read paper details
E. Orduña-Malea, Cristina I. Font-Julián, Jorge Serrano-Cobos
Given the importance of Google Search in generating visits to institutional repositories (IR), a lack of visibility in search engine results pages can hinder the possibility of their publications being found, read, downloaded, and, eventually, cited. To address this, institutions need to evaluate the visibility of their repositories to determine what actions might be implemented to enhance them. However, measuring the search engine optimization (SEO) visibility of IRs requires a highly accurate, technically feasible method. This study constitutes the first attempt to design such a method, specifically applied here to measuring the IR visibility of Spain’s national university system in Google Search based on a set of SEO-based metrics derived from the Ubersuggest SEO tool. A comprehensive dataset spanning three months and comprising 217,589 bibliographic records and 316,899 organic keywords is used as a baseline. Our findings show that many records deposited in these repositories are not ranked among the top positions in Google Search results, and that the most visible records are mainly academic works (theses and dissertations) written in Spanish in the Humanities and Social Sciences. However, most visits are generated by a small number of records. All in all, our results call into question the role played by IRs in attracting readers via Google Search to the institutions’ scientific heritage and serve to underscore the prevailing emphasis within IRs on preservation as opposed to online dissemination. Potential improvements might be achieved using enhanced metadata schemes and normalized description practices, as well as by adopting other actionable insights that can strengthen the online visibility of IRs. This study increases understanding of the role played by web indicators in assessing the web-based impact of research outputs deposited in IRs, and should be of particular interest for a range of stakeholders, including open access and open science advocates, research agencies, library practitioners, repository developers, and website administrators.
DOI: 10.1007/s11192-024-05175-0
Open source ↗The influence of search engine optimization on Google's results: A multi-dimensional approach for detecting SEO
D. Lewandowski, Sebastian Sünkler, Nurce Yagci · 2021 · Proceedings of the 13th ACM Web Science Conference 2021
Search engine optimization (SEO) can significantly influence what is shown on the result pages of commercial search engines. However, it is unclear what proportion of (top) results have actually been optimized. We developed a tool that uses a semi-automatic approach to detect, based on a given URL,…
Read paper details
D. Lewandowski, Sebastian Sünkler, Nurce Yagci
Search engine optimization (SEO) can significantly influence what is shown on the result pages of commercial search engines. However, it is unclear what proportion of (top) results have actually been optimized. We developed a tool that uses a semi-automatic approach to detect, based on a given URL, whether SEO measures were taken. In this multi-dimensional approach, we analyze the HTML code from which we extract information on SEO and analytics tools. Further, we extract SEO indicators on the page level and the website level (e.g., page descriptions and loading time of a website). We amend this approach by using lists of manually classified websites and use machine learning methods to improve the classifier. An analysis based on three datasets with a total of 1,914 queries and 256,853 results shows that a large fraction of pages found in Google is at least probably optimized, which is in line with statements from SEO experts saying that it is tough to gain visibility in search engines without applying SEO techniques.
DOI: 10.1145/3447535.3462479
Open source ↗View all papers (22)
ConsensusA page rank-based analytical design of effective search engine optimization
Vinutha Mysore Srinivas · 2025 · IAES International Journal of Artificial Intelligence (IJ-AI)
Search engine optimization (SEO) is an important internet marketing strategy and process that facilitates maximizing an intended website’s visibility with search engine results. It is widely employed nowadays to improve traffic volume or quality from search engines to a particular website. Even tho…
Read paper details
Vinutha Mysore Srinivas
Search engine optimization (SEO) is an important internet marketing strategy and process that facilitates maximizing an intended website’s visibility with search engine results. It is widely employed nowadays to improve traffic volume or quality from search engines to a particular website. Even though a significant number of publications imply the essential aspects of SEO, only a few provide generalized ideas to deal with the complex structure of the web. Also, the critical issues of content quality, site popularity, keyword density, and publicity factors were not much considered in the traditional ranking algorithms during SEO processes. This has negatively influenced the retrieval rate in the existing SEO techniques, and consequently, inadequate search results were obtained through search engines. Hence, the study considers web page ranking as a theoretical basis for the research and addresses these limitations in the existing system. It further improves SEO performance by introducing a unique web-page ranking strategic design to gain higher page rank results. The results of the investigational study show that the proposed system effectively contributes towards SEO with an improved page ranking strategy and also provides higher accuracy in calculating the importance score of web pages which is comparable with popular ranking algorithms such as hyperlink-induced topic search (HITS) and PageRank.
DOI: 10.11591/ijai.v14.i1.pp73-82
Open source ↗Maximizing Online Visibility, the Importance of Search Engine Optimization on Google
M. Simmons, T. Flannery · 2023 · International Journal of Research Publication and Reviews
Search Engine Optimization, commonly referred to as SEO, is a critical technique that businesses and individuals alike use to boost the visibility of their web pages in search engine results.SEO is essential in today's digital age because it allows web documents to be listed at the top of all searc…
Read paper details
M. Simmons, T. Flannery
Search Engine Optimization, commonly referred to as SEO, is a critical technique that businesses and individuals alike use to boost the visibility of their web pages in search engine results.SEO is essential in today's digital age because it allows web documents to be listed at the top of all search engine links, increasing the chances of attracting more traffic and, in turn, generating more revenue.The primary focus of this research paper is to explain the need for SEO with Google.Despite the widespread adoption of search engine optimization techniques, there are still many people who do not understand how it works or are facing difficulties when trying to optimize their web pages for Google.This research aims to provide a comprehensive understanding of SEO and how it can be used to increase the visibility of a website, specifically on Google.Google is the most user-friendly search engine, which has been proven by Indian users who have received direct and accurate results from Google.Furthermore, many other search engines use Google's search patterns, making it the preferred search engine for users worldwide.As a result, businesses and individuals need to improve the visibility of their web pages on Google to attract more traffic and customers.One of the most crucial aspects of SEO is increasing a web page's ranking on search engine results pages (SERPs).By utilizing various SEO techniques, such as optimizing content for specific keywords, improving site speed, and creating high-quality backlinks, web pages can improve their ranking on SERPs.The higher a page's ranking, the more visible it becomes to potential customers.SEO is a fundamental part of digital marketing, as it enables businesses to attract targeted traffic that is actively searching for products or services that they offer.With trillions of searches conducted every year, it is crucial to ensure that a business's web pages are visible to potential customers.The increased visibility achieved through SEO can result in profitable deals and a competitive edge over other businesses in the same industry.In conclusion, search engine optimization is a crucial aspect of digital marketing that every business and individual should adopt to boost the visibility of their web pages.By utilizing various SEO techniques, businesses can increase their web pages' ranking on SERPs and attract more targeted traffic.Google is the most widely used search engine, and optimizing web pages for Google is essential to remain competitive in today's digital landscape.With the ever-increasing importance of online visibility, SEO is an indispensable tool for businesses to succeed and grow.
DOI: 10.55248/gengpi.234.5.38049
Open source ↗Important Factors for Improving Google Search Rank
Christos Ziakis, M. Vlachopoulou, Theodosios Kyrkoudis, Makrina Karagkiozidou · 2019 · Future Internet
The World Wide Web has become an essential modern tool for people’s daily routine. The fact that it is a convenient means for communication and information search has made it extremely popular. This fact led companies to start using online advertising by creating corporate websites. With the rapid …
Read paper details
Christos Ziakis, M. Vlachopoulou, Theodosios Kyrkoudis, Makrina Karagkiozidou
The World Wide Web has become an essential modern tool for people’s daily routine. The fact that it is a convenient means for communication and information search has made it extremely popular. This fact led companies to start using online advertising by creating corporate websites. With the rapid increase in the number of websites, search engines had to come up with a solution of algorithms and programs to qualify the results of a search and provide the users with relevant content to their search. On the other side, developers, in pursuit of the highest rankings in the search engine result pages (SERPs), began to study and observe how search engines work and which factors contribute to higher rankings. The knowledge that has been extracted constituted the base for the creation of the profession of Search Engine Optimization (SEO). This paper consists of two parts. The first part aims to perform a literature review of the factors that affect the ranking of websites in the SERPs and to highlight the top factors that contribute to better ranking. To achieve this goal, a collection and analysis of academic papers was conducted. According to our research, 24 website characteristics came up as factors affecting any website’s ranking, with the most references mentioning quality and quantity of backlinks, social media support, keyword in title tag, website structure, website size, loading time, domain age, and keyword density. The second part consists of our research which was conducted manually using the phrases “hotel Athens”, “email marketing”, and “casual shoes”. For each one of these keywords, the first 15 Google results were examined considering the factors found in the literature review. For the measurement of the significance of each factor, the Spearman correlation was calculated and every factor was compared with the ranking of the results individually. The findings of the research showed us that the top factors that contribute to higher rankings are the existence of website SSL certificate as well as keyword in URL, the quantity of backlinks pointing to a website, the text length, and the domain age, which is not perfectly aligned with what the literature review showed us.
DOI: 10.3390/fi11020032
Open source ↗Domain specific information retrieval system
Sandi Pohorec, M. Verlic, M. Zorman · 2009 ·
In the fast evolving world that we live in today, the search for information has become increasingly important. Of course the tool that we use almost exclusively for this task is an internet search engine. We are all very familiar with the capabilities of large scale search engines, such as Google.…
Read paper details
Sandi Pohorec, M. Verlic, M. Zorman
In the fast evolving world that we live in today, the search for information has become increasingly important. Of course the tool that we use almost exclusively for this task is an internet search engine. We are all very familiar with the capabilities of large scale search engines, such as Google. Naturally a question arises if there is really a need to develop another search engine although on a smaller, local, domain oriented level. We believe that the answer will, at least in the foreseeable future, be positive. The reasons for this are: access to privileged information, personalization and custom ranking functions. The paper describes a centralized search service for domain specific content. The approach uses automated indexing for various content that can be in the form of a relational database, web service, web portal or page, various document formats and other structured or unstructured data. The indexed data is accessible through a highly optimized and personalized search service.
A rapid method to increase transparency and efficiency in web-based searches
Neal R Haddaway, A. Collins, D. Coughlin, Stuart Kirk · 2017 · Environmental Evidence
BackgroundMany online search facilities allow searching for academic literature. The majority are bibliographic databases that catalogue published research in an iterative, semi-automated manner, e.g. Web of Science Core Collections, which indexes articles published in selected journals. Other reso…
Read paper details
Neal R Haddaway, A. Collins, D. Coughlin, Stuart Kirk
BackgroundMany online search facilities allow searching for academic literature. The majority are bibliographic databases that catalogue published research in an iterative, semi-automated manner, e.g. Web of Science Core Collections, which indexes articles published in selected journals. Other resources, such as Google Scholar, identify academic articles by using search engines that crawl the internet for potentially relevant information. Often, systematic reviewers wish to document their searches for transparency or later screening. Indeed, such transparency is a cornerstone of systematic review methodology. Whilst bibliographic databases typically allow users to extract search results as citations in bulk, several other key resources, such as Google Scholar and organisation websites, do not allow this: citations must be extracted individually, which is often prohibitively time consuming.MethodsHere, we describe novel methods for downloading results from searches of websites and web-based search engines into comprehensive databases as citations using free-to-use software. Citations from web-based search engines can then be integrated into review procedures along with those from traditional online bibliographic databases.Results and conclusionsThese methods substantially increase transparency and repeatability when searching online resources. They may also significantly reduce resource requirements for such searches and therefore represent a significant increase in efficiency.
DOI: 10.1186/s13750-016-0079-2
Open source ↗Completeness degree of publication metadata in eight free-access scholarly databases
Lorena Delgado-Quirós, José Luis Ortega · 2024 · Quantitative Science Studies
Abstract The main objective of this study is to compare the amount of metadata and the completeness degree of research publications in new academic databases. Using a quantitative approach, we selected a random Crossref sample of more than 115,000 records, which was then searched in seven databases…
Read paper details
Lorena Delgado-Quirós, José Luis Ortega
Abstract The main objective of this study is to compare the amount of metadata and the completeness degree of research publications in new academic databases. Using a quantitative approach, we selected a random Crossref sample of more than 115,000 records, which was then searched in seven databases (Dimensions, Google Scholar, Microsoft Academic, OpenAlex, Scilit, Semantic Scholar, and The Lens). Seven characteristics were analyzed (abstract, access, bibliographic info, document type, publication date, language, and identifiers), to observe fields that describe this information, the completeness rate of these fields, and the agreement among databases. The results show that academic search engines (Google Scholar, Microsoft Academic, and Semantic Scholar) gather less information and have a low degree of completeness. Conversely, third-party databases (Dimensions, OpenAlex, Scilit, and The Lens) have more metadata quality and a higher completeness rate. We conclude that academic search engines lack the ability to retrieve reliable descriptive data by crawling the web, and the main problem of third-party databases is the loss of information derived from integrating different sources.
DOI: 10.1162/qss_a_00286
Open source ↗Dark sides of artificial intelligence: The dangers of automated decision‐making in search engine advertising
Carsten D. Schultz, Christian Koch, Rainer Olbrich · 2024 · Journal of the Association for Information Science and Technology
With the growing use of artificial intelligence, search engine providers are increasingly pushing advertisers to use automated bidding strategies based on machine learning. Such automated decision‐making systems leave advertisers in the dark about the data being used and how they can influence the …
Read paper details
Carsten D. Schultz, Christian Koch, Rainer Olbrich
With the growing use of artificial intelligence, search engine providers are increasingly pushing advertisers to use automated bidding strategies based on machine learning. Such automated decision‐making systems leave advertisers in the dark about the data being used and how they can influence the outcome of the decision‐making process. Previous literature on artificial intelligence lacks an understanding of the dangers related to artificially intelligent systems and their lack of transparency. In response, our paper addresses the inherent risks of the automated optimization of advertisers' bidding strategies in search engine advertising. The selected empirical case of a service company therefore demonstrates how data availability can trigger a long‐term decline in advertising performance and how search engine advertising performance metrics develop before and after an event of data scarcity. Based on data collected for 525 days, difference‐in‐differences analysis shows that the algorithmic approach has a considerable and lasting negative impact on advertising performance. Furthermore, the empirical case indicates that self‐regulated learning can initialize a downward spiral that gradually impairs advertising performance. Thus, the aim of this study is to increase awareness regarding automated decision‐making dangers in search engine advertising and help advertisers take preventive measures to reduce the risks of algorithm missteps.
DOI: 10.1002/asi.24798
Open source ↗ResearchGate and Google Scholar: how much do they differ in publications, citations and different metrics and why?
V. Singh, Satya Swarup Srichandan, H. Lathabai · 2021 · Scientometrics
ResearchGate has emerged as a popular professional network for scientists and researchers in a very short span. Similar to Google Scholar, the ResearchGate indexing uses an automatic crawling algorithm that extracts bibliographic data, citations, and other information about scholarly articles from …
Read paper details
V. Singh, Satya Swarup Srichandan, H. Lathabai
ResearchGate has emerged as a popular professional network for scientists and researchers in a very short span. Similar to Google Scholar, the ResearchGate indexing uses an automatic crawling algorithm that extracts bibliographic data, citations, and other information about scholarly articles from various sources. However, it has been observed that the two platforms often show different publication and citation data for the same institutions, journals, and authors. While several previous studies analysed different aspects of ResearchGate and Google Scholar, the quantum of differences in publications, citations, and metrics between the two and the probable reasons for the same are not explored much. This article, therefore, attempts to bridge this research gap by analysing and measuring the differences in publications, citations, and different metrics of the two platforms for a large data set of highly cited authors. The results indicate that there are significantly high differences in publications and citations for the same authors captured by the two platforms, with Google Scholar having higher counts for a vast majority of the cases. The different metrics computed by the two platforms also differ in their values, showing different degrees of correlation. The coverage policy, indexing errors, author attribution mechanism, and strategy to deal with predatory publishing are found to be the main probable reasons for the differences in the two platforms.
DOI: 10.1007/s11192-022-04264-2
Open source ↗Which academic search systems are suitable for systematic reviews or meta‐analyses? Evaluating retrieval qualities of Google Scholar, PubMed, and 26 other resources
Michael Gusenbauer, Neal R Haddaway · 2020 · Research Synthesis Methods
Rigorous evidence identification is essential for systematic reviews and meta-analyses (evidence syntheses) because the sample selection of relevant studies determines a review's outcome, validity, and explanatory power. Yet, the search systems allowing access to this evidence provide varying level…
Read paper details
Michael Gusenbauer, Neal R Haddaway
Rigorous evidence identification is essential for systematic reviews and meta-analyses (evidence syntheses) because the sample selection of relevant studies determines a review's outcome, validity, and explanatory power. Yet, the search systems allowing access to this evidence provide varying levels of precision, recall, and reproducibility and also demand different levels of effort. To date, it remains unclear which search systems are most appropriate for evidence synthesis and why. Advice on which search engines and bibliographic databases to choose for systematic searches is limited and lacking systematic, empirical performance assessments. This study investigates and compares the systematic search qualities of 28 widely used academic search systems, including Google Scholar, PubMed, and Web of Science. A novel, query-based method tests how well users are able to interact and retrieve records with each system. The study is the first to show the extent to which search systems can effectively and efficiently perform (Boolean) searches with regards to precision, recall, and reproducibility. We found substantial differences in the performance of search systems, meaning that their usability in systematic searches varies. Indeed, only half of the search systems analyzed and only a few Open Access databases can be recommended for evidence syntheses without adding substantial caveats. Particularly, our findings demonstrate why Google Scholar is inappropriate as principal search system. We call for database owners to recognize the requirements of evidence synthesis and for academic journals to reassess quality requirements for systematic reviews. Our findings aim to support researchers in conducting better searches for better evidence synthesis. © 2019 The Authors. Research Synthesis Methods published by John Wiley & Sons Ltd.
DOI: 10.1002/jrsm.1378
Open source ↗Invisible Institutional Repositories: Addressing the Low Indexing Ratios of IRs in Google Scholar
Kenning Arlitsch, Patrick S. O'Brien · 2012 · Libr. Hi Tech
Purpose – Google Scholar has difficulty indexing the contents of institutional repositories, and the authors hypothesize the reason is that most repositories use Dublin Core, which cannot express bibliographic citation information adequately for academic papers. Google Scholar makes specific recomm…
Read paper details
Kenning Arlitsch, Patrick S. O'Brien
Purpose – Google Scholar has difficulty indexing the contents of institutional repositories, and the authors hypothesize the reason is that most repositories use Dublin Core, which cannot express bibliographic citation information adequately for academic papers. Google Scholar makes specific recommendations for repositories, including the use of publishing industry metadata schemas over Dublin Core. This paper aims to test a theory that transforming metadata schemas in institutional repositories will lead to increased indexing by Google Scholar.Design/methodology/approach – The authors conducted two surveys of institutional and disciplinary repositories across the USA, using different methodologies. They also conducted three pilot projects that transformed the metadata of a subset of papers from USpace, the University of Utah's institutional repository, and examined the results of Google Scholar's explicit harvests.Findings – Repositories that use GS recommended metadata schemas and express them in HTML m...
DOI: 10.1108/07378831211213210
Open source ↗Commercial Web sites: lost in cyberspace?
M. Thelwall · 2000 · Internet Res.
How easy are business web sites for potential customers to find? This paper reports on a survey of 60087 web sites from 42 of the major general and commercial domains around the world to extract statistics about their design and rate of search engine registration. Search engines are used by the maj…
Read paper details
M. Thelwall
How easy are business web sites for potential customers to find? This paper reports on a survey of 60087 web sites from 42 of the major general and commercial domains around the world to extract statistics about their design and rate of search engine registration. Search engines are used by the majority of web surfers to find information on the web. However, 23% of business web sites in the survey were not registered at all in the five major search engines tested and 82% were not registered in at least one, missing a sizeable potential audience. There are some simple steps that should also be taken to help a web site to be indexed properly in search engines, primarily the use of HTML META tags for indexing, but only about a third of the site home pages in the survey used them. Wide national variations were found for both indexing and META tag inclusion.
DOI: 10.1108/10662240010322939
Open source ↗Implementation of Semantic Search in an Academic Repository Using Sentence-BERT and FAISS
I. Lubis, Husni Lubis · 2026 · sinkron
Academic repositories serve as centralized platforms for storing and managing scientific documents, including research papers, reports, and administrative records. Yet, traditional keyword-based search systems often struggle to deliver relevant results. These systems typically fail to capture the c…
Read paper details
I. Lubis, Husni Lubis
Academic repositories serve as centralized platforms for storing and managing scientific documents, including research papers, reports, and administrative records. Yet, traditional keyword-based search systems often struggle to deliver relevant results. These systems typically fail to capture the contextual meaning of user queries, which leads to mismatches when the query terms differ from those found in the documents. To overcome this limitation, this study introduces a semantic search approach for academic repositories by combining Sentence-BERT as the text embedding model with FAISS as the vector-based similarity search engine. In the proposed system, documents stored in a MySQL database are first preprocessed to remove HTML tags, then converted into semantic vector representations using Sentence-BERT. These vectors are indexed with FAISS, enabling fast and efficient similarity searches compared to conventional keyword matching. The system architecture integrates FastAPI as the backend service for indexing, searching, and evaluation, while CodeIgniter 4 functions as the frontend framework for document management by administrators and end users. Evaluation was carried out using three test sets, each containing ten queries. Performance was measured using Recall@K, normalized Discounted Cumulative Gain (nDCG), Mean Reciprocal Rank (MRR), Mean Average Precision (MAP), and search latency. Experimental results show that the system achieved an average Recall@K of 0.61, a MAP of 0.39, and a No-Hit rate of 0.033, meaning all queries successfully retrieved results. Although the nDCG value declined in the third test set, the system consistently returned relevant documents.
DOI: 10.33395/sinkron.v10i2.15940
Open source ↗Google's Deep Web crawl
Jayant Madhavan, David Ko, Lucja Kot, Vignesh Ganapathy, Alex Rasmussen, A. Halevy · 2008 · Proc. VLDB Endow.
The Deep Web, i.e., content hidden behind HTML forms, has long been acknowledged as a significant gap in search engine coverage. Since it represents a large portion of the structured data on the Web, accessing Deep-Web content has been a long-standing challenge for the database community. This pape…
Read paper details
Jayant Madhavan, David Ko, Lucja Kot, Vignesh Ganapathy, Alex Rasmussen, A. Halevy
The Deep Web, i.e., content hidden behind HTML forms, has long been acknowledged as a significant gap in search engine coverage. Since it represents a large portion of the structured data on the Web, accessing Deep-Web content has been a long-standing challenge for the database community. This paper describes a system for surfacing Deep-Web content, i.e., pre-computing submissions for each HTML form and adding the resulting HTML pages into a search engine index. The results of our surfacing have been incorporated into the Google search engine and today drive more than a thousand queries per second to Deep-Web content. Surfacing the Deep Web poses several challenges. First, our goal is to index the content behind many millions of HTML forms that span many languages and hundreds of domains. This necessitates an approach that is completely automatic, highly scalable, and very efficient. Second, a large number of forms have text inputs and require valid inputs values to be submitted. We present an algorithm for selecting input values for text search inputs that accept keywords and an algorithm for identifying inputs which accept only values of a specific type. Third, HTML forms often have more than one input and hence a naive strategy of enumerating the entire Cartesian product of all possible inputs can result in a very large number of URLs being generated. We present an algorithm that efficiently navigates the search space of possible input combinations to identify only those that generate URLs suitable for inclusion into our web search index. We present an extensive experimental evaluation validating the effectiveness of our algorithms.
DOI: 10.14778/1454159.1454163
Open source ↗Equal Representation by Search Engines? A Comparison of Websites across Countries and Domains
L. Vaughan, Yanjun Zhang · 2007 · J. Comput. Mediat. Commun.
The study examined search engine coverage of websites across countries and domains. Websites in four domains (commercial, educational, governmental, and organizational) from four countries (U.S., China, Singapore, and Taiwan) were randomly sampled by custom-built computer programs and then manually…
Read paper details
L. Vaughan, Yanjun Zhang
The study examined search engine coverage of websites across countries and domains. Websites in four domains (commercial, educational, governmental, and organizational) from four countries (U.S., China, Singapore, and Taiwan) were randomly sampled by custom-built computer programs and then manually filtered for their suitability for the study. Representation of the 1,664 sampled sites in four major search engines (Google, Yahoo!, MSN, and Yahoo! China) was examined in terms of whether the site was covered and the number of pages indexed by the search engines. The study found that U.S. sites received higher coverage rates than their counterparts in other countries. The language of a site did not affect the site’s chance of being indexed by search engines. Sites that were more visible had a higher chance of being indexed, but this factor did not seem to explain the differentiated coverage across countries. Yahoo! China provided better coverage of sites from China and surrounding regions than its global counterpart, Yahoo!. The poor coverage of Chinese commercial and governmental sites is noted and the implications are discussed in light of the tremendous development of the Web in China.
DOI: 10.1111/j.1083-6101.2007.00355.x
Open source ↗Octobot - Web Scarping towards retrieving Google Scholar Data
Maroua Alhabib Aljemazi, M. Khder · 2022 · 2022 ASU International Conference in Emerging Technologies for Sustainability and Intelligent Systems (ICETSIS)
Web crawling is widely used these days in many different applications which can efficiently crawl the internet to provide the user with relevant results by utilizing its core algorithm. Google Scholar is one of the very important websites that contains a huge data about researchers and their resear…
Read paper details
Maroua Alhabib Aljemazi, M. Khder
Web crawling is widely used these days in many different applications which can efficiently crawl the internet to provide the user with relevant results by utilizing its core algorithm. Google Scholar is one of the very important websites that contains a huge data about researchers and their research output along with the different citation counts. In this paper we try to utilize we crawling to retrieve the Google scholar data for Applied Science University-Bahrain by developing a searching engine tailored for this purpose. To achieve that goal, several sorts of web crawlers, and their architecture is presented briefly. Moreover, looking through numerous existing web crawlers to study their benefits and drawbacks in order to determine which criteria this web crawler should address. In addition, assess reducing online crawling techniques. Based on prior work and accepted software comparison measures, an assessment framework for comparing online crawling solutions is designed and used to aid the process. The implemented Web Crawler (OCTOBOT) is presented and different usage scenarios were shown.
DOI: 10.1109/icetsis55481.2022.9888872
Open source ↗A risk analysis of a smart home automation system
A. Jacobsson, Martin Boldt, Bengt Carlsson · 2016 · Future Gener. Comput. Syst.
Enforcing security in Internet of Things environments has been identified as one of the top barriers for realizing the vision of smart, energy-efficient homes and buildings. In this context, understanding the risks related to the use and potential misuse of information about homes, partners, and …
Read paper details
A. Jacobsson, Martin Boldt, Bengt Carlsson
Enforcing security in Internet of Things environments has been identified as one of the top barriers for realizing the vision of smart, energy-efficient homes and buildings. In this context, understanding the risks related to the use and potential misuse of information about homes, partners, and end-users, as well as, forming methods for integrating security-enhancing measures in the design is not straightforward and thus requires substantial investigation. A risk analysis applied on a smart home automation system developed in a research project involving leading industrial actors has been conducted. Out of 32 examined risks, 9 were classified as low and 4 as high, i.e., most of the identified risks were deemed as moderate. The risks classified as high were either related to the human factor or to the software components of the system. The results indicate that with the implementation of standard security features, new, as well as, current risks can be minimized to acceptable levels albeit that the most serious risks, i.e., those derived from the human factor, need more careful consideration, as they are inherently complex to handle. A discussion of the implications of the risk analysis results points to the need for a more general model of security and privacy included in the design phase of smart homes. With such a model of security and privacy in design in place, it will contribute to enforcing system security and enhancing user privacy in smart homes, and thus helping to further realize the potential in such IoT environments.
DOI: 10.1016/j.future.2015.09.003
Open source ↗Multicentre prospective risk analysis of a fully automated radiotherapy workflow
G. de Kerf, A. Barragán-Montero, Charlotte L. Brouwer, Pietro Pisciotta, M. Biston, M. Fusella, Geo… · 2025 · Physics and Imaging in Radiation Oncology
Background and Purpose: Fully automated workflows (FAWs) for radiotherapy treatment preparation are feasible, but remain underutilized in clinical settings. A multicentre prospective risk analysis was conducted to support centres in managing FAW-related risks and to identify workflow steps needing …
Read paper details
G. de Kerf, A. Barragán-Montero, Charlotte L. Brouwer, Pietro Pisciotta, M. Biston, M. Fusella, Geoffroy Herbin, E. Kneepkens, Livia Marrazzo, Joshua Mason, Camila Panduro Nielsen, Koen Snijders, S. Tanadini-Lang, A. Vaandering, Tomas Janssen
Background and Purpose: Fully automated workflows (FAWs) for radiotherapy treatment preparation are feasible, but remain underutilized in clinical settings. A multicentre prospective risk analysis was conducted to support centres in managing FAW-related risks and to identify workflow steps needing improvement. Material and Methods: Eight European radiotherapy centres performed a failure mode and effect analysis (FMEA) on a hypothetical FAW, with a manual review step at the end. Centres assessed occurrence, severity and detectability of provided, or newly added, failure modes to obtain a risk score. Quantitative analysis was performed on curated data, while qualitative analysis summarized free text comments. Results: Manual review and auto-segmentation were identified as the highest-risk steps and the highest scoring failure modes were associated with inadequate manual review (high detectability and severity score), incorrect (i.e. outside of intended use) application of the FAW (high severity score) and protocol violations during patient preparation (high occurrence score). The qualitative analysis highlighted amongst others the risk of deviation from protocol and the difficulty for manual review to recognize automation errors. The risk associated with the technical parts of the workflow was considered low. Conclusions: The FMEA analysis highlighted that points where people interact with the FAW were considered higher risk than lack of trust in the FAW itself. Major concerns were the ability of people to correctly judge output in case of low generalizability and increasing skill degradation. Consequently, educational programs and interpretative tools are essential prerequisites for widespread clinical application of FAWs. © 2025 The Author(s).
DOI: 10.1016/j.phro.2025.100765
Open source ↗AutoML to Date and Beyond: Challenges and Opportunities
Shubhra (Santu) Karmaker, Md. Mahadi Hassan, Micah J. Smith, Lei Xu, Chengxiang Zhai, K. Veeramacha… · 2020 · ACM Computing Surveys (CSUR)
As big data becomes ubiquitous across domains, and more and more stakeholders aspire to make the most of their data, demand for machine learning tools has spurred researchers to explore the possibilities of automated machine learning (AutoML). AutoML tools aim to make machine learning accessible fo…
Read paper details
Shubhra (Santu) Karmaker, Md. Mahadi Hassan, Micah J. Smith, Lei Xu, Chengxiang Zhai, K. Veeramachaneni
As big data becomes ubiquitous across domains, and more and more stakeholders aspire to make the most of their data, demand for machine learning tools has spurred researchers to explore the possibilities of automated machine learning (AutoML). AutoML tools aim to make machine learning accessible for non-machine learning experts (domain experts), to improve the efficiency of machine learning, and to accelerate machine learning research. But although automation and efficiency are among AutoML’s main selling points, the process still requires human involvement at a number of vital steps, including understanding the attributes of domain-specific data, defining prediction problems, creating a suitable training dataset, and selecting a promising machine learning technique. These steps often require a prolonged back-and-forth that makes this process inefficient for domain experts and data scientists alike and keeps so-called AutoML systems from being truly automatic. In this review article, we introduce a new classification system for AutoML systems, using a seven-tiered schematic to distinguish these systems based on their level of autonomy. We begin by describing what an end-to-end machine learning pipeline actually looks like, and which subtasks of the machine learning pipeline have been automated so far. We highlight those subtasks that are still done manually—generally by a data scientist—and explain how this limits domain experts’ access to machine learning. Next, we introduce our novel level-based taxonomy for AutoML systems and define each level according to the scope of automation support provided. Finally, we lay out a roadmap for the future, pinpointing the research required to further automate the end-to-end machine learning pipeline and discussing important challenges that stand in the way of this ambitious goal.
DOI: 10.1145/3470918
Open source ↗An Automated Machine Learning (AutoML) Method of Risk Prediction for Decision-Making of Autonomous Vehicles
Xiupeng Shi, Y. Wong, C. Chai, M. Z. Li · 2020 · IEEE Transactions on Intelligent Transportation Systems
This study presents a domain-specific automated machine learning (AutoML) for risk prediction and behaviour assessment, which can be used in the behavioural decision-making and motion trajectory planning of autonomous vehicles (AVs). The AutoML enables end-to-end machine learning from vehicle movem…
Read paper details
Xiupeng Shi, Y. Wong, C. Chai, M. Z. Li
This study presents a domain-specific automated machine learning (AutoML) for risk prediction and behaviour assessment, which can be used in the behavioural decision-making and motion trajectory planning of autonomous vehicles (AVs). The AutoML enables end-to-end machine learning from vehicle movement and sensing data to detailed risk levels and corresponding behaviour characteristics, which integrates three main components of: unsupervised risk identification by surrogate risk indicators and big data clustering, feature learning based on XGBoost, and model auto-tuning by Bayesian optimisation. Then, the functions and performance of AutoML are evaluated based on NGSIM data, with assumptions of various sensing configurations or data acquisition conditions. AutoML achieves satisfactory results of behaviour-based risk prediction, which has a predictive power of 91.7% overall accuracy for four risk levels, and about 95% accuracy for safe-risk distinction. Bayesian optimisation guides the self-learning of AutoML to get the optimised feature subsets and hyperparameter values. The identification of key features not only produces better performance with fewer computation costs, but also provides data-driven insights about AV design, such as sensor configurations and sensor data mining, from risk decision-making perspectives. The application potentials of AutoML in AVs are discussed.
DOI: 10.1109/tits.2020.3002419
Open source ↗Disagreements & Limitations
Disagreements
- Effectiveness of repository preservation versus dissemination strategies: Emphasis on preservation in academic repositories inherently limits search visibility; Online dissemination remains achievable through metadata enhancements without compromising preservation. Differing assessments of institutional priorities and SEO resource allocation, based on observed repository traffic patterns versus theoretical potential for optimization.
Limitations
- Empirical repository analysis [C482] limited to Spanish institutions; global generalizability unknown
- Theoretical models [C483, C484] rely on historical datasets with potential obsolescence given rapid algorithm changes
- Literature review [C486] published in 2019, missing five years of SEO developments
Sources
Automation of technological and business processes · 2023 · DOI: 10.15673/atbp.v15i2.2516
Open sourcehttps://consensus.app/papers/increase-website-visibility-on-the-internet-by-google-sakaliuk-shershun/24e5a66d6f8256edad49cecf6b2d6d3e/?utm_source=publicapiScientometrics · 2024 · DOI: 10.1007/s11192-024-05175-0
Open sourcehttps://consensus.app/papers/open-access-publications-drive-few-visits-from-google-ordua-malea-font-julin/b93aab043ab158c69de684bd9fa4dbeb/?utm_source=publicapiProceedings of the 13th ACM Web Science Conference 2021 · 2021 · DOI: 10.1145/3447535.3462479
Open sourcehttps://consensus.app/papers/the-influence-of-search-engine-optimization-on-googles-lewandowski-snkler/4f1caa3ef808559090e22477405a044a/?utm_source=publicapiIAES International Journal of Artificial Intelligence (IJ-AI) · 2025 · DOI: 10.11591/ijai.v14.i1.pp73-82
Open sourcehttps://consensus.app/papers/a-page-rankbased-analytical-design-of-effective-search-srinivas/6efec038073b529ca97325d004a04a97/?utm_source=publicapiInternational Journal of Research Publication and Reviews · 2023 · DOI: 10.55248/gengpi.234.5.38049
Open sourcehttps://consensus.app/papers/maximizing-online-visibility-the-importance-of-search-simmons-flannery/47713319e0c0521899c67c1b4e9e3efb/?utm_source=publicapiFuture Internet · 2019 · DOI: 10.3390/fi11020032
Open sourcehttps://consensus.app/papers/important-factors-for-improving-google-search-rank-ziakis-vlachopoulou/357636e6e26659d68be1dcb0fd0075cb/?utm_source=publicapi· 2009
Open sourcehttps://consensus.app/papers/domain-specific-information-retrieval-system-pohorec-verlic/b3cac8007b0d5fec91455566768fcd01/?utm_source=publicapiEnvironmental Evidence · 2017 · DOI: 10.1186/s13750-016-0079-2
Open sourcehttps://consensus.app/papers/a-rapid-method-to-increase-transparency-and-efficiency-in-haddaway-collins/14cb626c890f5d938f69681d79038092/?utm_source=publicapi