Web scraping is a technique used for automated collection of data and information from websites. It enables gathering of large volumes of web-based information on specific topics, significantly facilitating and accelerating the exploration of vast online data resources. The unstructured data collected is converted into a structured format, allowing it to be processed using big data techniques and/or NLP methods.
The Web Scraping Lab was established to conduct research at both stages of this process: data collection from the Web and subsequent analysis. Teaching activities are also aligned with this direction, aiming to engage students in web scraping challenges and the development of practical solutions.
The Laboratory was founded in 2022 by staff members of the JU Institute of Information Studies Department of Information Research Methodology. Its creation was made possible thanks to a grant awarded under the JU Excellence Initiative – POB DigiWorld project titled Web Scraping in the Analysis of the Level of Datafication of Polish Scientific Institutions, which funded the purchase of computer equipment. Additional funding from the 'Strategic Infrastructure' task, secured by the Institute authorities, enabled the acquisition of software and the organisation of staff training.
Core team members:
- Dr hab. Marek Nahotko, Prof. UJ
- Dr Aneta Januszko-Szakiel
- Dr Małgorzata Jaskowska
- Magdalena Zych
Contributors:
- Dr Paloma Korycińska
- Dr Marek Deja
Selected research output:
- Nahotko, M., Zych, M., Januszko-Szakiel, A., Jaskowska, M. (2023). Big Data-Driven Investigation into the Maturity of Library Research Data Services (RDS). Journal of Academic Librarianship, vol. 49, art. 102646.
- Nahotko, M., Januszko-Szakiel, A., Jaskowska, M., Zych, M. (2022). Presence of research data management (RDM) issues on the websites of Polish academic libraries Ed. M. Nahotko. Kraków : JU, Jagiellonian Library.
- Nahotko, M. (2022). Meta-Synthesis in Information Systems Diagnosis. In: S. Cisek, M. Wójcik (eds.), Diagnostics in information management : the perspective of communication and media studies in the context of development of interdisciplinary research, pp. 157–170. Kraków: JU, Jagiellonian Library.
- Zych, M. (2022). Diagnostic Aspects of AIIP Members’ Business Activities. In: S. Cisek, M. Wójcik (eds.), Diagnostics in information management : the perspective of communication and media studies in the context of development of interdisciplinary research, pp. 171–192. Kraków: JU, Jagiellonian Library.