I am trying to scrape table data from a website.
Here is a simple example table:
t = '<html><table>' +
'<tr><td class="label"> a </td> <td> 1 </td></tr>' +
'<tr><td class="label"> b </td> <td> 2 </td></tr>' +
'<tr><td class="label"> c </td> <td> 3 </td></tr>' +
'<tr><td class="label"> d </td> <td> 4 </td></tr>' +
'</table></html>'
Desired parse result is {' a ': ' 1 ', ' b ': ' 2 ', ' c ': ' 3 ', ' d ' : ' 4' }
This is my closest attempt so far:
for tr in s.findAll('tr'):
k, v = BeautifulSoup(str(tr)).findAll('td')
d[str(k)] = str(v)
Result is:
{'<td class="label"> a </td>': '<td> 1 </td>', '<td class="label"> d </td>': '<td> 4 </td>', '<td class="label"> b </td>': '<td> 2 </td>', '<td class="label"> c </td>': '<td> 3 </td>'}
I'm aware of the text=True parameter of findAll() but I'm not getting the expected results when I use it.
I'm using python 2.6 and BeautifulSoup3.
See Question&Answers more detail:
os 与恶龙缠斗过久,自身亦成为恶龙；凝视深渊过久,深渊将回以凝视…
