bash - Read in and parse textfile -


i need parse file (txt) , display 10 lines of queries number of bytes. (sort) have file log.txt:

164.94.76.83.cust.bluewin.ch - - [17/oct/2006:07:56:45 -0700] "get /example/serif.css http/1.1" 200 4824 "http://www.example.org/example/when/200x/2003/07/25/notgaming" "mozilla/5.0 (windows; u; windows nt 5.1; de; rv:1.8.0.7) gecko/20060909 firefox/1.5.0.7" 164.94.76.83.cust.bluewin.ch - - [03/oct/2006:07:56:45 -0700] "get /example/example.js http/1.1" 200 6685 "http://www.example.org/example/when/200x/2003/07/25/notgaming" "mozilla/5.0 (windows; u; windows nt 5.1; de; rv:1.8.0.7) gecko/20060909 firefox/1.5.0.7" 164.94.76.83.cust.bluewin.ch - - [06/oct/2006:07:56:46 -0700] "get /example/when/200x/2003/07/25/nuke.png http/1.1" 200 19757 "http://www.example.org/example/when/200x/2003/07/25/notgaming" "mozilla/5.0 (windows; u; windows nt 5.1; de; rv:1.8.0.7) gecko/20060909 firefox/1.5.0.7" 164.94.76.83.cust.bluewin.ch - - [15/oct/2006:07:56:46 -0700] "get /example/when/200x/2003/07/25/diablo.png http/1.1" 200 12597 "http://www.example.org/example/when/200x/2003/07/25/notgaming" "mozilla/5.0 (windows; u; windows nt 5.1; de; rv:1.8.0.7) gecko/20060909 firefox/1.5.0.7" 164.94.76.83.cust.bluewin.ch - - [19/oct/2006:07:56:46 -0700] "get /example/when/200x/2003/07/25/-big/nuke.jpg http/1.1" 403 322 "

output must (with count in % , links - , sort desc): 

1. http://www.example.org/example/when/200x/2006/09/25/ - 3100 - 74%                                                     2. http://www.example.org/example/ - 1000 - 24%                 3. http://www.example.org/example/genx/docs/guide.html - 91 - 2%

that is, necessary highlight line maximum number of bytes in request sort , indicate amount of interest.

since insist on shell-only approach, closest solution ask seems this:

sort -t ' ' -k 10 -r -n log.txt | head -n 10 | awk '{print $1 $7, $10}'

you can (much) better either setting more useful logformat when logging requests, or allowing perl or python parser when processing logs.


Comments

Post a Comment

Popular posts from this blog

jquery - How do you format the date used in the popover widget title of FullCalendar? -

Image
in fullcalendar, how format date used in popover widget title when clicking '+n more'? code: <div class="fc-popover fc-more-popover"> <div class="fc-header fc-widget-header"> <span class="fc-close fc-icon fc-icon-x"></span> <span class="fc-title">tuesday, april 7</span> ... </div> ... </div> you use daypopoverformat that. determines date format of title of popover created eventlimitclick option. must date formatting string. default value "dddd, mmmm d" english , "ll" other languages.
Read more

asp.net mvc - SSO between MVCForum and Umbraco7 -

i need integrate sso between mvcforum (forum of company) , umbraco7 (manages cms company). however struggling shared authentication work. tried several ways suggested on other threads still not running expected. here did: 1. in mvcforum (forum.mywebsite.com) 1.1. machine key in web.xml: <machinekey validationkey="the same key umbraco7" decryptionkey="the same key umbraco7" validation="sha1" decryption="aes" /> 1.2. authenticate forms in web.xml <forms name="my-sso-auth" protection="all" path="/" timeout="43200" domain="forum.mywebsite.com" loginurl="/members/logon" enablecrossappredirects="true" /> 2. in umbraco7 (news.mywebsite.com) 2.1. machine key in web.xml: <machinekey validationkey="the same key mvcforum" decryptionkey="the same key mvcforum" validation="sha1" decryption="aes" /> 2.2. a...
Read more

Python Tkinter keyboard using bind -

i have problem using bind option can click button in keyboard, , call function once key pressed. tried taking other codes have similar purpose , saw i'm doing pretty same, though still have problem must've missed. thankful if me this. here's code: # -*- coding: utf-8 -*- #imports tkinter import * pil import imagetk, image import time import tkmessagebox #===========================================================================================================================================# #tkinter class class app(frame): def __init__(self, master=none): frame.__init__(self, master) self.pack() #===========================================================================================================================================# #game pieces classes class board: def __init__(self, rows = 7, columns = 6, picture_height = none, picture_width = none): self.rows = rows self.columns = columns self.picture ...
Read more