From 52c490cc24505640497805b1ec1bfd98273cc512 Mon Sep 17 00:00:00 2001 From: Wladimir Schmidt Date: Thu, 11 Jan 2024 12:16:30 +0100 Subject: Add multithreaded generation of measurements file with Gaussian distribution (M2 AIR took 24 seconds for 1B items) (#175) * Add multithreaded variant to generate measurements * Add removing existing measurements.txt file in case exists (for usability reasons) Fix bug for number of lines generated * Fix also for less than assumed chunk size (10M entries) per thread --- create_measurements_fast.sh | 19 +++++++++++++++++++ 1 file changed, 19 insertions(+) create mode 100755 create_measurements_fast.sh (limited to 'create_measurements_fast.sh') diff --git a/create_measurements_fast.sh b/create_measurements_fast.sh new file mode 100755 index 0000000..37e98e0 --- /dev/null +++ b/create_measurements_fast.sh @@ -0,0 +1,19 @@ +#!/bin/sh +# +# Copyright 2023 The original authors +# +# Licensed under the Apache License, Version 2.0 (the "License"); +# you may not use this file except in compliance with the License. +# You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, software +# distributed under the License is distributed on an "AS IS" BASIS, +# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +# See the License for the specific language governing permissions and +# limitations under the License. +# + + +java --class-path target/average-1.0.0-SNAPSHOT.jar dev.morling.onebrc.CreateMeasurementsFast $1 -- cgit v1.2.3