fast-scan: Plan and create benchmarks for performance improvements

[pombredanne]

ScanCode is accurate, but could be made much faster. Feedback from community users often include complaints about the speed of scans. This addresses these concerns with a focused initiative to improve the performance for both ScanCode Toolkit and ScanCode.io.

To scan faster, we nee to start by measuring. This means creating benchmarks to establish a baseline for each scanner and tool. We should establish and publish a baseline benchmark and profile scan performance hotspots as part of the efforts to improve overall performance of scancode toolkit and scancode.io.

• fast-scan: Create scan benchmark for license detection in ScanCode Toolkit #4059
• fast-scan: Create scan benchmark for copyright detection in ScanCode Toolkit #4060
• fast-scan: Create scan benchmark for package detection in ScanCode Toolkit #4061
• fast-scan: Establish profile of ScanCode Toolkit performance hotspots and issues using benchmarks #4062
• fast-scan: Create scan benchmark for package/license/copyright/fingerprint scan in ScanCode.io scancode.io#1499
• fast-scan: Establish profile of ScanCode.io performance hotspots and issues using benchmarks scancode.io#1500