- 0
Efficient/fast CSV file from client (Windows) to server (CentOS)
-
Recently Browsing 0 members
- No registered users viewing this page.
-
Posts
-
By zikalify · Posted
From cars to cosmos: Honda's experimental rocket aces first landing test by Paul Hill Image via Honda Watch your back SpaceX, the Japanese company Honda has just performed a successful first launch of its experimental reusable rocket. The 6.3 meter rocket, which weighs 900kg, reached a modest altitude of 271.4 meters, but managed to land within 37cm of its target (1.2 feet), which is certainly pretty close. The rocket took off from a Honda facility in Taiki Town, Hokkaido, a growing space town in Japan. The flight time was also modest, coming in at just 56.6 seconds, but in that time, Honda was able to demonstrate key reusability technologies such as flight stability and landing capability. This marks a significant milestone for Honda’s space R&D department, which began work just four years ago. If you remember the tests SpaceX was performing around 2012 with Grasshopper, well Honda is at about the same stage with its reusable rocket. Why Honda is building rockets: Beyond cars and motorcycles Honda said that it wants to leverage core technologies it already works on for offering space services. It said that reusable rockets are a key part of sustainable space transportation. By 2029, the company wants to be able to perform suborbital launches, and while commercialization hasn’t been decided yet, it sees itself launching remote-sensing and wide-area communication satellites in the future. The Japanese car maker sees growing demand for satellite launches and wants to be involved by developing reusable rockets which could help it perform such launches economically. If it does end up finding customers, it will add more competition to the rocket launch sector. While the company hasn’t confirmed this, by developing its own launch system, it could eventually be in a position to launch its own satellites that could provide services to its cars to add value for customers. The competitive landscape and Japan's space ambitions Honda is just the latest company to join the growing list of companies trying to develop reusable rocket technology. The most famous companies doing this are SpaceX and Blue Origin, but there are also lots of other companies around the world also developing this technology. Honda is still taking baby steps compared to SpaceX, but it shows that the company is taking a focused, step-by-step approach, and achieving successes as noted by this launch. Hopefully, the company ends up providing tough competition against SpaceX, Blue Origin, and other companies so that it can help to drive down prices and spur on innovation. -
By +Nik Louch · Posted
Does that subscription include international data roaming, inclusive of Russia? -
By Nick H. · Posted
If you're stupid enough to try and get one, each and every headache along the way is on you. I can only hope that these roadblocks on a pre-order are enough to dissuade people. -
By Nick H. · Posted
"You should have a Microsoft Account because we can help keep your data safe...until we can't." As an IT guy I know that I should never put my trust in one backup solution if the data is important. But for non-IT people, they are getting tricked into Microsoft's practices with falsehoods. -
By Lamp0 · Posted
it is delayed and has no definitive release date... that is "delayed indefinitely".
-
-
Recent Achievements
-
TBithoney earned a badge
Week One Done
-
xuxlix earned a badge
First Post
-
Tomek Święcicki earned a badge
First Post
-
carlitin86 earned a badge
One Year In
-
Peterlll06 earned a badge
Reacting Well
-
-
Popular Contributors
-
Tell a friend
Question
sini
Hello, I am seeking some guidance on the best possible way to send a CSV file from a Windows client to CentOS server with the lowest overheads. The CSV file changes perhaps 2-3 times a second and I need to send this to the server for data capture and processing. This send process happens for perhaps 8 hours and then sleeps for weeks or sometimes months. When not sleeping I need to send the CSV as fast as possible, once per second would be acceptable. Appreciate any suggestions or guidance.
Client side current: Run a program and sends data when datafile.csv file is modified. Uploads via WinSCP / SFTP. Overhead of SFTP mean transfer takes 1-3 seconds before sending latest data meaning might miss some critical data now and then. Over the course of ~8 hours I might miss say 10% of data.
Client side required: Run a program and sends current data CSV file to server as fast as possible. Ideally not a queue as queue would likely grow faster than file can be sent. Ideally executable file with no other software requirements. Ideal outcome would be data transfer of datafile.csv from client/server started and finished once per second.
Server side : I am checking file timestamp and only running the software if datafile.csv is newer than 2 hours, after which it sleeps and checks every 1 minute following. I am happy with this.
CSV file : The file is small, ~100-200 bytes. Single line CSV with about 80 positions.
Link to comment
https://www.neowin.net/forum/topic/1406839-efficientfast-csv-file-from-client-windows-to-server-centos/Share on other sites
1 answer to this question
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now