python - Parsing links and strings from unstructured HTML data -


i have html string looks this:

        <p>                                 type: <a href="wee.html">tough</a><br />                                  main type:                 <a href='abnormal.html'>abnormal</a>                    <br />                                   wheel:                 <a href='none.html'>none</a>,<a href='squared.html'>squared</a>,<a href='triangle.html'>triangled</a>                    <br />                                  movement type: <a href=forward.html">forward</a><br />                                  level: <a href="beginner.html">beginner</a><br />             sport: <a href="no.html">no</a><br/>force: <a href="pull.html">pull</a><br/>              <span style="float:left;">your rating:&nbsp;</span> <div id="headersmallrating" style="float:left; line-height:20px;"><a href="rate.html">login rate</a></div><br />          </p>

in other words unstructured. want able first detect strings type , main type plus links (and link text). have tried detecting words regular expression, not serve purpose. how 1 handle kind of dodgy data?

if know categories beforehand type, force, etc, it's perhaps easier prepare list in advance.

code:

from bs4 import beautifulsoup bsoup import re  ofile = open("test.html", "rb") soup = bsoup(ofile) soup.prettify()  categories = ["type:","main type:","wheel:","movement type:","level:","sport:","force:"] category in categories:     f = soup.find(text=re.compile(category)).next_sibling     string = f.get_text()     ref = f.get("href")     print "%s %s (%s)" % (category, string, ref)

result:

type: tough (wee.html) main type: abnormal (abnormal.html) wheel: none (none.html) movement type: forward (forward.html) level: beginner (beginner.html) sport: no (no.html) force: pull (pull.html) [finished in 0.2s]

let me know if helps.

edit:

this handle wheel if has multiple elements after it.

code:

from bs4 import beautifulsoup bsoup, tag import re  ofile = open("unstructured.html", "rb") soup = bsoup(ofile) soup.prettify()  categories = ["type:","main type:","wheel:","movement type:","level:","sport:","force:"] category in categories:     wheel_list = []     f = soup.find(text=re.compile(category)).next_sibling     if category != "wheel:":         string = f.get_text()         ref = f.get("href")         print "%s %s (%s)" % (category, string, ref)     else:         while f.name == "a":             content = f.contents[0]             res = f.get("href")             wheel_list.append("%s (%s)" % (content, res))             f = f.find_next()         ref = ", ".join(wheel_list)         print "%s %s" % (category, ref)

result:

type: tough (wee.html) main type: abnormal (abnormal.html) wheel: none (none.html), squared (squared.html), triangled (triangle.html) movement type: forward (forward.html) level: beginner (beginner.html) sport: no (no.html) force: pull (pull.html) [finished in 0.3s]

let know if helps.


Comments

Post a Comment

Popular posts from this blog

apache - Remove .php and add trailing slash in url using htaccess not loading css -

i have add following code htaccess file removing .php extension , add trailing slash urls. worked fine reduced page loading speed , css code not loading @ all. pages ugly. please help rewriteengine on rewritebase / ## hide .php extension snippet # externally redirect /dir/foo.php /dir/foo rewritecond %{the_request} ^[a-z]{3,}\s([^.]+)\.php [nc] rewriterule ^ %1/ [r,l] # add trailing slash rewritecond %{request_filename} !-f rewritecond %{request_uri} !/$ rewriterule . %{request_uri}/ [l,r=301] # internally forward /dir/foo /dir/foo.php rewritecond %{request_filename} !-d rewritecond %{request_filename}.php -f rewriterule ^(.*?)/?$ $1.php [l] we can rewrite urls using .htaccess files. before writing in .htaccess files need verify kind of server using. can check server adding a <?php phpinfo(); ?> in php page. ensure mod_rewrite module enabled in apache server. can identified checking phpinfo included page. common methods used url rewriting follows ...
Read more

javascript - jQuery show full size image on click -

pretty self explanatory not workking . i want display full image when user click on image... yes know there tons of plugins but i want keep simple. any idea ? css : .full { display: none; width: 500px; height: 500px; margin-left: 100px; margin-top: -300px; position: fixed; background-color: #f00; z-index: 6; } .thumbnail { width: 50px; height: 50px; } html: <img class="thumbnail" src="http://4.bp.blogspot.com/-uhbdp2esxng/txneptvi92i/aaaaaaaaaky/upfqis7zto0/s1600/rihanna-wallpaper.jpg"> jquery: $(document).ready(function() { $('.thumbnail').on('click', function() { var img = $('<img />',{src:this.src,'class':'full'}); $('.full').html(img).show(); console.log('done!'); }); }); try looking how jquery works. $(document).ready(function() { $('.thumbnail').on('click', function(...
Read more