Abstract
We introduce GrapAL (Graph database of Academic Literature), a versatile tool for exploring and investigating a knowledge base of scientific literature that was semi-automatically constructed using NLP methods. GrapAL fills many informational needs expressed by researchers. At the core of GrapAL is a Neo4j graph database with an intuitive schema and a simple query language. In this paper, we describe the basic elements of GrapAL, how to use it, and several use cases such as finding experts on a given topic for peer reviewing, discovering indirect connections between biomedical entities, and computing citation-based metrics. We open source the demo code to help other researchers develop applications that build on GrapAL.
1 Introduction
Researchers rely on scientific literature to perform a wide variety of tasks such as searching for papers, assessing applicants for a research position and keeping track of papers published on topics of interest. Several software tools are available to help researchers perform these tasks. For example, many biomedical researchers use PubMed to find papers relevant for their studies, 2 Google Scholar allows researchers to verify and curate their user profiles, 3 and Semantic Scholar extracts research topics, figures, and tables from papers and links them to external content such as slides, videos and GitHub repositories. 4 However, such tools tend to only feature the most commonly used functionalities in order to keep the interface simple for users, ignoring the long tail of informational needs such as finding experts on a given topic, identifying potential collaborators, assessing influence between research areas, and discovering connections between biological entities.
In this paper, we address these limitations by introducing a tool that provides a flexible and efficient way to query the Semantic Scholar knowledge base, a semi-automatically constructed knowledge base of scientific literature (Ammar et al., 2018) . In addition to bridging the gap between available tools and informational needs of researchers, GrapAL demonstrates how semiautomatically constructed knowledge bases can be effectively used to solve real-world problems.
GrapAL is publicly available at grapal. allenai.org, along with documentation. 5 In the following section ( §2), we introduce the schema and query language used in GrapAL and discuss how users can connect to the database. In §3, we show how GrapAL can be used to satisfy several compelling case studies. In §4, we discuss some of the design choices and the system architecture for GrapAL.
2 How To Use Grapal
GrapAL is designed to satisfy many use cases requested by Semantic Scholar users who need to process scientific literature. To achieve this, we design GrapAL as a Neo4j property graph with an intuitive schema, making it queryable with the Cypher query language (Francis et al., 2018) .
Schema. Fig. 1 demonstrates the schema of our graph database, which consists of 7 node types (displayed in turquoise) and 8 edge types (displayed in purple). The properties associated with [SMOKING,CANCER] , represents an n-ary relationship of type Relation (via a WITH RELATIONSHIP edge) between two or more Entity nodes (via WITH ENTITY edges). Details on how we extract entities and various metadata for each paper can be found in Ammar et al. (2018) . The only schema changes introduced in this work are including Affiliation and Venue nodes (and corresponding edge types), and optimizing for query execution time. Table 1 provides the number of instances of each node and edge type in the schema at the time of this writing.
Query Language. Before we discuss realistic case studies in §3, we introduce the query lan-guage used in GrapAL with a few toy examples:
First, consider the following query that matches arbitrary author nodes in GrapAL and returns the first 10: // Find arbitrary authors. MATCH (a:Author) RETURN a LIMIT 10
More often than not, we only want to match nodes with some desired properties. In the next example, we only match authors with first name 'Clarence' and last name 'Ellis'. Note the round brackets used to specify an instance of node type Author, and the curly brackets used to specify its properties.
// Find authors by name. MATCH (a:Author {last: "Ellis", first:
"Clarence"})
→ RETURN a
Alternatively, we could use a WHERE clause to specify the desired properties of matched nodes, as demonstrated in the following example that matches papers by their title. This example also shows how to match nodes by specifying their relation to another node, e.g., authors of a paper. Note the use of square brackets to specify edges and the arrow to specify edge direction. More information about the Cypher query language can be found in Francis et al. (2018) .
Connecting to GrapAL. Users can query GrapAL in a variety of methods. First, an interactive graphical interface is available at https://grapal.allenai.org: 7473/browser/ that is suitable for interactive exploration of GrapAL with a relatively small number of results. We demonstrate how the interactive interface could be used in a screencast. 6 Users can also build web applications that leverage GrapAL through the Neo4j HTTP endpoint. 7 As an example, we have developed a simple web-based application at https://grapal. allenai.org/app that can be used to load any of the case studies described in the next section. 8 Users can also type in arbitrary queries, share the queries with collaborators, and download the results in JSON format.
Users can also query the graph natively in their favourite programming language using one of the Neo4j language drivers. Neo4j officially supports five languages: .NET, Java, Javascript, Go and Python, but additional drivers are available. 9 We provide an example of using the Python driver to compute disruption scores as described in Wu et al. (2019) . 10 DOI and ArXivId Compatibility. Users can switch between Digital Object Identifiers (DOIs) or arXiv identifiers (ArXivId) and paper IDs with the Semantic Scholar API 11 . For example, we can look up the paper node corresponding to the DOI 10.1038/nrn3241 by first executing the HTTP query https://api.semanticscholar. org/v1/paper/10.1038/nrn3241 that returns a JSON object with paper ID 931d6b6ee097eab80b8f89a313c8d3a6d 5443cb2. Then, we execute the Cypher query: // Look up paper by ID. MATCH (p:Paper {paper_id:
"931d6b6ee097eab80b8f89a313c8d3 a6d5443cb2"}) → → RETURN p
In the future, we plan to add DOI properties and ArXivId properties to the knowledge base.
3 Case Studies
We interviewed computer science and biomedical researchers to better understand the kinds of questions they would like to answer from a knowledge base of scientific literature. In this section, we focus on some of the more compelling use cases that were identified in the interviews, and provide example queries to address them in GrapAL.
For each example we give a link to load the query in the query loader and the full text of the query. From the query loader, users can view or save the results of a query and also copy it to be pasted into the Neo4j browser, where users can view interactive visualizations of the query results.
Shortest Path. Consider a researcher a seeking an introduction or an endorsement to work with another researcher b. By finding the shortest path between the two researchers in Gra-pAL, researcher a can identify common collaborators connecting the two. The following query, for instance, matches a path connecting Swabha Swayamdipta and Regina Barzilay using authorship edges only, and returns a path that connects them via Luke Zettlemoyer who co-authored papers with both researchers (see Fig. 2 ). 12 // Find shortest path between two researchers by name. In this example, we constrain the number and type of edges in the graph to a maximum of six AUTHORS edges. For authors with an ambiguous name, it may be necessary to specify the author by their ID, which can be found by inspecting their author page URL on Semantic Scholar: 13 // Find shortest path between two researchers, one by author ID. Similar queries can be used to find colleagues who published at a given venue, or currently work at a given university or research lab.
Finding Experts. One of the pain points in organizing a conference is identifying reviewers who are knowledgeable about the research topics discussed in submitted papers. By querying GrapAL, members of the organizing committee will be able to find more competent reviewers, while relying less on their (often biased) professional network when deciding whom to invite for peer reviewing. For example, the following query can be used to find researchers who published the most on "Relationship extraction" since 2013. 14 // Find authors who published the most on relation extraction since 2013. Here, we use ORDER BY cp DESC to sort the authors by the number of papers they published on this topic. In order to find the node that represents a topic of interest in GrapAL, users could use the search feature on semantic scholar and inspect the relevant topic page URL for the entity ID, or use regular expressions to query GrapAL, e.g., 15 // Fuzzy matching of entity names. MATCH (e:Entity) WHERE e.name =˜"(?i)relationship extraction" RETURN e 13 E.g., Swabha Swayamdipta's author page URL is https://www.semanticscholar.org/author/ Swabha-Swayamdipta/2705113
14 This query can be loaded and modified at https:// grapal.allenai.org/app/?example=experts 15 This query can be loaded and modified at https://grapal.allenai.org/app/?example= canonical-entity Papers at the Intersection of Entities. Search engine results sometimes make it difficult to find papers that discuss multiple topics or fields. With GrapAL, we can return papers that discuss any number of entities of interest, e.g., "Constraint programming" and "Natural language processing". Fig. 3 shows a visualization of the results on the Neo4j browser, limited to 10 papers. 16 // Find papers which mention both constraint programming and natural language processing. Connecting Scientific Concepts. Some researchers wanted to explore direct and indirect connections between two scientific concepts (entities) of interest, e.g., the impact of 'adjuvant antiestrogen therapy (Arimidex)' on 'estrogen receptors'. Using GrapAL, we can find how two entities are indirectly connected via coded relationships and a chain of entities in the knowledge base, which can help generate new hypotheses or quickly assess the viability of a hypothesis before conducting expensive lab experiments. 17 // Find path between Estrogen Receptors and Arimidex via coded relationships. This query returns a list of triples (e0, r, e1) that connect 'Arimidex' to 'Estrogen Receptors'. The UNWIND operator allows us to examine each node on the shortest path and process it as needed.
Citation-Based Metrics. Citations are often used as a proxy for the impact of papers, researchers or venues. In addition to computing traditional metrics such as h-index and i10-index, GrapAL can also be used to compute more granular metrics, e.g., to estimate the rate at which papers in one conference cite papers in another conference: 18 // Find the number of times a NAACL paper cites a CVPR paper. This query returns the number of times a NAACL paper cites a CVPR paper. We use the =˜operator to match on venue names by regular expression because venues are stored as unstructured strings.
4 System Design
Graph Database. Due to the high connectivity in the data and the nature of queries GrapAL is designed for, we opted to create GrapAL using a graph-native database instead of a more conventional relational database. Unlike a relational database, a graph database provides a natural and efficient way to query and traverse multi-hop relations without using computationally expensive join operations. Several graph database systems have recently become available, including AWS Neptune, Grakn.ai, dgraph and Neo4j. We decided to build GrapAL on Neo4j since it is one of the more mature platforms, has a strong community of developers, and is the most widely used graph database system as of the time of this writing. 19 One limitation of Neo4j is that it is not a distributed database system, but we were able to fit GrapAL on a single server.
Building and Deploying GrapAL. GrapAL is powered by the same data that powers the semanticscholar.org website, as described in Ammar et al. (2018) . We use a staging server to read a snapshot of the data as Spark DataFrames from AWS S3 and write CSV files that match the property schema described earlier. Due to the sheer amount of records, we process different shards of the data in parallel before aggregating all shards into one CSV file for each node and edge type of the schema. Then, we use the Neo4j CSV import function to build the database. Once we've built the database, we start up a Neo4j server and run a Cypher script to create indexes. The staging server is an EC2 machine with instance type r5.24xlarge. This process takes around 6 hours and the resulting database is roughly 80 GB (including indexes).
Once the data is imported, the database files are copied over to a production server that serves the dataset publicly and has lower processor and memory requirements compared to the staging server. The staging server is an EC2 machine with instance type r4.16xlarge. We plan to rebuild GrapAL at a monthly cadence with new snapshots of the data.
5 Related Work
Related APIs are available to help researchers navigate scientific literature. Singh et al. (2018) provides an API to interact with the ACL anthology. However, it is limited to the areas of computational linguistics and natural langauge processing, and it uses a predefined list of query templates with placeholders for authors, papers and venues. Springer Nature SciGraph 20 provides an API for accessing publication metadata from the Springer Nature corpus, but it is limited to papers and books published by Springer Nature. The Microsoft Academic Graph (Shen et al., 2018) is similarly an API for examining academic literature. As a relational database, it is hard to query with complex, multi-hop relations as discussed in §4. This work is also related to a line of NLP work focusing on scientific documents including citation prediction (e.g., Yogatama et al., 2011; Bhagavatula et al., 2018) , author modeling (e.g., Sim et al., 2015) , stylometry (e.g., Bergsma et al., 2012) , bibliometrics (e.g., Foulds and Smyth, 2013; Weihs and Etzioni, 2017) and information extraction (e.g., Kergosien et al., 2018; Andruszkiewicz and Hazan, 2018) .
6 Conclusion
GrapAL is a versatile tool for exploring and investigating scientific literature built on the Neo4j graph database framework. We describe the basic elements of GrapAL, how to use it, and use cases such as finding experts on a given topic for peer reviewing, discovering indirect connections between biomedical entities, and computing citation-based metrics.
Future improvements include more metadata and changes to the structure of affiliation and venue data. We intend to change the data pipeline architecture to perform event-based incremental updates rather than a regular batch build. We continue to improve the models used to populate Gra-pAL's nodes and edges (e.g., author disambiguation and entity extraction and linking).
A screencast of the tool is available at https: //www.youtube.com/watch?v=1ivX9sHw2RU& feature=youtu.be
https://www.youtube.com/watch?v= 1ivX9sHw2RU&feature=youtu.be 7 Documentation for the API is available at https:// neo4j.com/docs/http-api/3.5/ 8 For example, the following URL will load the shortest path example: https://grapal.allenai.org/ app/?example=shortest-path 9 See https://neo4j.com/developer/ language-guides/ for the complete list of Neo4j language drivers.10 https://gist.github.com/chrstnb/ 088f7699930ad53e757906f4d3d6c1f511 http://api.semanticscholar.org/
This query can be loaded and modified at https://grapal.allenai.org/app/?example= shortest-path
This query can be loaded and modified at https://grapal.allenai.org/app/?example= intersecting-entities 17 This query can be loaded and modified at https://grapal.allenai.org/app/?example= scientific-concepts
This query can be loaded and modified at https://grapal.allenai.org/app/?example= citation-metrics
https://db-engines.com/en/ranking/ graph+dbms 20 https://scigraph.springernature.com/ explorer