Evolving our support for text-and-data mining

Key Points

• Text-and-data mining processes often yield unreliable results, leading to data extraction errors and inconsistencies.
• Screen-scraping techniques are frequently problematic, posing a burden on content sites due to their reliance on changing site layouts.
• Existing methods can be unrepeatable, resulting in difficulties for researchers attempting to conduct consistent data analysis.
• The focus needs to shift toward developing more robust and adaptable methods for effective scholarly content mining.