AI Tools in Academia: Evaluating NotebookLM as a Tool for Conducting Literature Reviews

OBJECTIVE: The proliferation of access to generative AI tools has the potential to radically alter the process of writing manuscripts. This report evaluates NotebookLM as a tool for conducting a literature review in an ethical and responsible manner.

METHOD: We uploaded 22 relevant papers from the Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS) to NotebookLM and asked questions pertaining to a hypothetical research paper. We investigated the capabilities, limitations, ethical considerations, and privacy implications of using NotebookLM and engaged in a dialogue with the tool through a series of user-written prompts and AI responses.

RESULTS: We found that the variability and utility of responsesweres determined in large part by the ability to write meaningful prompts and the extent to which new prompts provided additional information. Investigating how NotebookLM identified key findings enhanced our prompt generation and subsequently the iterative refinement of output to produce information relevant to our mock literature review.

CONCLUSIONS: The utility of NotebookLM will likely vary by the quality of source material uploaded into the program and the researcher's familiarity with prompt generation. There are a number of benefits and drawbacks to using this tool as a search engine or conversation partner. Ethical considerations and privacy implications of using NotebookLM are discussed.