Announcements & Updates:

- New packages are added for more security and better display.

- Newly registered users got limited access to contribute in contents now.
Image

Large Log files

Data Analysis And Visualization of Data
User avatar
Shahram
Posts: 267
Joined: Sun Feb 05, 2017 8:31 am

Large Log files

Postby Shahram » Thu Jun 01, 2017 11:10 am

Working with large log files is almost painfully slow. One way to deal with large files is to split them to smaller files and then work on them. Finally you can join them together.

To split :

Code: Select all

split -b <size> <your-file>

For example:

Code: Select all

split -b 23750k cosang.log


To join:

Code: Select all

cat xa* > <your-file>


For example:

Code: Select all

cat xa* > finallog.log




User avatar
Shahram
Posts: 267
Joined: Sun Feb 05, 2017 8:31 am

Re: Large Log files

Postby Shahram » Mon Jul 03, 2017 3:23 pm

Quick tip:
grep is a powerful command to work with large files. You can search in log files even though you can't open them using normal editors.

Samples and comprehensive description :
https://www.computerhope.com/unix/ugrep.htm




Return to “Data Analysis And Visualization”

Who is online

Users browsing this forum: No registered users and 2 guests