/ #software / #automation / #browser
In the fast-paced realm of web scraping, efficiency is paramount. Traditional tools like #Selenium and #Playwright, while robust, often grapple with performance bottlenecks due to their synchronous operations. At Scraping Solution, our relentless pursuit of more agile and responsive alternatives led us to an emerging gem in the field: #Pydoll.
У меня проблема:
- Есть скрипт на #Python, он использует #Selenium и #Firefox.
- В одной(!) вкладке по очереди открываются странички. И с каждой открытой страничкой потребление ОЗУ увеличивается на 100-200Мб забивает мне всю ОЗУ и весь свап.
Вопрос:
- Какого хуя?
- Как это исправить?
Этим скриптом я пользуюсь уже лет пять и раньше такой херни не было.
#Alberta #DanielleSmith #UCP #CoalMines #NorthBack #Selenium #Contamination #Poison #Fisheries #CrossNestRiver #OldManRiver #ToxicContamination #NoCoalMines #EasternSlopes #Rockies #SaveOurWater #SaveOurMountains
https://open.substack.com/pub/crowsnestheadwaters/p/news-release-alberta-silent-on-government?utm_campaign=post&utm_medium=web
Czy to nie wspaniałe, że kiedy wysyłasz łatkę, która wyłącznie zmienia wartość zwracaną przez funkcję, opisujesz szczegółowo, dlaczego ta zmiana jest konieczna — a następnie jakiś przypadkowy bot #AI do przeglądu łatek wygotowuje wodę z morza po to, żeby napisać, że łatka zmienia wartość zwracaną przez funkcję, i ktoś powinien sprawdzić, czy ta zmiana jest pożądana?
Isn't it great when you submit a pull request whose sole purpose is changing the return value of a function, and you describe in detail why are you changing it — and then some random #AI pull request review bot boils oceans to say that the pull request is changing the return value of a function, and the reviewer may need to consider if that change is desired?
Selenium explained by our speaker Pallavi Sharma during our Continuous Testing Meetup event
Your logs are lying to you - metrics are meaner and better.
Everyone loves logs… until the incident postmortem reads like bad fan fiction.
Most teams start with expensive log aggregation, full-text searching their way into oblivion. So much noise. So little signal. And still, no clue what actually happened. Why? Because writing meaningful logs is a lost art.
Logs are like candles, nice for mood lighting, useless in a house fire.
If you need traces to understand your system, congratulations: you're already in hell.
Let me introduce my favourite method: real-time, metric-driven user simulation aka "Overwatch".
Here's how you do it:
Set up a service that runs real end-to-end user workflows 24/7. Use Cypress, Playwright, Selenium… your poison of choice.
Every action creates a timed metric tagged with the user workflow and action.
Now you know exactly what a user did before everything went up in flames.
Use Grafana + InfluxDB (or other tools you already use) to build dashboards that actually tell stories:
* How fast are user workflows?
* Which steps are breaking, and how often?
* What's slower today than yesterday?
* Who's affected, and where?
Alerts now mean something.
Incidents become surgical strikes, not scavenger hunts.
Bonus: run the same system on every test environment and detect regressions before deployment. And if you made it reusable, you can even run the service to do load tests.
No need to buy overpriced tools. Just build a small service like you already do, except this one might save your soul.
And yes, transform logs into metrics where possible. Just hash your PII data and move on.
Stop guessing. Start observing.
Metrics > Logs. Always.
Python Skript um mehrere Jira Installationen mit einheitlichen Plugin Versionen auszustatten (für Dev Umgebungen):
https://gitlab.com/packhack/python-jira/-/blob/main/jiraInstallPluginsSelenium.py
Lenny Winkel, our associate Professor of Inorganic Environmental Geochemistry, studies the environmental behavior of trace elements like #selenium. Grown up in the Netherlands, she loves the Swiss mountains! 
#EnvironmentalScience #Selenium #Geochemistry
New research explores #selenium's potential in cancer treatment. A Phase 1 clinical trial found combining selenium with #chemotherapy effectively treated metastatic kidney cancer, with over half of patients seeing tumor shrinkage. 
https://buff.ly/3Db0Jeq
Join Our Full Stack Software Testing Training!
Master Manual & Automation Testing, Selenium, JIRA, Web Services, and Frameworks with expert-led training!
New Batch: 5th March 2025
Time: 7:30 AM - 9:00 AM (IST)
Mode: Classroom & Online
Learn manual & automation testing Hands-on projects & real-world scenarios Career guidance & certification support
Register Now: https://t.ly/FsST-5
New research explores #selenium's potential in cancer treatment. A Phase 1 clinical trial found combining selenium with #chemotherapy effectively treated metastatic kidney cancer, with over half of patients seeing tumor shrinkage. https://theconversation.com/selenium-is-an-essential-nutrient-named-after-the-greek-goddess-of-the-moon-crucial-to-health-it-may-help-prevent-and-treat-cancer-248548
By Aliasger K. Salem, University of Iowa
While comparing #Selenium to Playwright and Cypress is off, today I saw a comparison to entire commercial test Automation platform that is built on top of Selenium. Yes, a piece of your thing is less than your thing. I guess the name of the piece is relevant enough.
Is understanding Selenium already a lost cause?
Learn Selenium Web Scraping with Python to extract product URLs from eCommerce sites! Master CSS selectors & XPath for efficient & ethical data analysis & automation. #WebScraping #Python #Selenium #eCommerce #DataAnalysis #Automation
https://tech-champion.com/data-science/selenium-web-scraping-python-extract-product-urls-from-e-commerce-sites
@annearchet @scarpentier Y'a sûrement un(e) geek qui va proposer d'automatiser avec python+selenium comme je l'ai fait ici (pour automatiser la commande de crayons sur le site du cegep 
). Sûr, ce n'est pas du matos érotique 
mais le principe est le même: tout ce qu'un usager accomplit comme tâche via un browser peut-être automatisé... mais il faut fouiller dans le html du site pour bâtir les invocations de Selenium 
https://selenium-python.readthedocs.io/
A co powiecie na jakieś gówniane narzędzie #AI do szukania błędów w łatkach, które twierdzi, że w moim TOML-u brakuje zamknięcia listy, bo owe gówno "widzi" tylko cztery pierwsze jej elementy?
https://github.com/SeleniumHQ/selenium/pull/15128#issuecomment-2605090127
Cóż, nigdy nie uważałem #Selenium za szczególnie dobrej jakości bibliotekę (no ale męczy się z trudnym tematem), ale teraz już powiem wprost: trzymajcie się od tego projektu z daleka.
Qiita - 人気の記事 
Wix