Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Penetration Testing is Stupid - BsidesSF 2013
Search
Brett Hardin
February 25, 2013
Technology
2
2.2k
Penetration Testing is Stupid - BsidesSF 2013
Brett Hardin
February 25, 2013
Tweet
Share
More Decks by Brett Hardin
See All by Brett Hardin
Building Your House on Sand
bretthardin
2
1.5k
Bad Version of Builders vs. Breakers
bretthardin
1
74
Builders vs. Breakers - AppSec 2012
bretthardin
2
1.5k
Security the Wrong Way
bretthardin
2
250
BSidesSanFrancisco2011 - Misdirection: The Rise and Fall and Rise of Regulatory Compliance
bretthardin
1
220
Security? Who Cares! - Privacy is Dead
bretthardin
1
180
OWASP - Top 10
bretthardin
0
1k
Other Decks in Technology
See All in Technology
RDS の負荷が高い場合に AWS で取りうる具体策 N 連発/a-series-of-specific-countermeasures-available-on-aws-when-rds-is-under-high-load
emiki
7
4.2k
Geospatialの世界最前線を探る [2025年版]
dayjournal
1
260
Databricks AI/BI Genie の「値ディクショナリー」をAmazonの奥地(S3)まで見に行く
kameitomohiro
1
300
Introduction to Sansan Meishi Maker Development Engineer
sansan33
PRO
0
310
SCONE - 動画配信の帯域を最適化する新プロトコル
kazuho
0
110
ガバメントクラウドの概要と自治体事例(名古屋市)
techniczna
3
240
React19.2のuseEffectEventを追う
maguroalternative
2
520
データ戦略部門 紹介資料
sansan33
PRO
1
3.8k
Performance Insights 廃止から Database Insights 利用へ/transition-from-performance-insights-to-database-insights
emiki
0
320
業務効率化をさらに加速させる、ノーコードツールとStep Functionsのハイブリッド化
smt7174
2
150
OAuthからOIDCへ ― 認可の仕組みが認証に拡張されるまで
yamatai1212
0
140
20251007: What happens when multi-agent systems become larger? (CyberAgent, Inc)
ornew
1
470
Featured
See All Featured
Building an army of robots
kneath
306
46k
Designing Experiences People Love
moore
142
24k
The Illustrated Children's Guide to Kubernetes
chrisshort
49
51k
Performance Is Good for Brains [We Love Speed 2024]
tammyeverts
12
1.2k
[RailsConf 2023] Rails as a piece of cake
palkan
57
5.9k
jQuery: Nuts, Bolts and Bling
dougneiner
65
7.9k
Designing Dashboards & Data Visualisations in Web Apps
destraynor
231
53k
No one is an island. Learnings from fostering a developers community.
thoeni
21
3.5k
Easily Structure & Communicate Ideas using Wireframe
afnizarnur
194
16k
Six Lessons from altMBA
skipperchong
29
4k
Mobile First: as difficult as doing things right
swwweet
225
10k
Visualization
eitanlees
149
16k
Transcript
Penetration Testing is stupid
Brett Hardin @miscsecurity
None
None
pentesters
Why Who Where When What PENETRATION TESTING Why Who Where
When What
Why Who Where When What PENETRATION TESTING What
Audience Participation Educated Guess?
A live test of the effectiveness of security defenses through
mimicking the actions of real-life attackers. ISACA
test security defenses
mimicking real-life attackers
MIMIC THE REAL
Gunter Ollmann of Damballa on Real Attacks
Submit CV 2000
USB Keys 2005 2000
Buy the machine 2009+ 2005 2000
Penetration tests are unique
Penetration testers are friendly
Penetration tests don’t simulate attacks
Why Who Where When What PENETRATION TESTING Who
The Average Penetration tester
performed by
Jack Nicholson
I’M A PROFESSIONAL TRUST ME.
I’LL TRY ‘PASSWORD’
I’LL TRY ‘PA55WORD’
LET ME IN. PLEASE.
YOU WILL LET ME IN.
WE’RE FRIENDS
WHY CAN’T I GET IN?
LOOK, A WAY IN.
THEY WERE SO DUMB
I’M GONNA REDRUM HIM
pentesters
The average penetration tester
The average are common
The average are necessary
The average are cheap
The average are simple to copy
The average follow methodologies
The best penetration testers
The best are rare
The best invent new attacks
The best are expensive
The best are overkill
The best mimic the real
The average mimic tools
MIMIC THE REAL
MIMIC THE REAL
Why Who Where When What PENETRATION TESTING When
ATTACKS happen when you’re asleep
ATTACKS happen when you’re on vacation
ATTACKS happen when you have no budget
ATTACKS happen when during business hours
ATTACKS happen when you are not ready
ATTACKS happen when you are ready PENTESTS
Date&Time&Resources
None
Attackers aren’t limited by resources
MIMIC THE REAL
MIMIC THE REAL
Why Who Where When What PENETRATION TESTING Where
Rules of Engagement
Internet
Web Application only
On-site
Dialup
The Wi-fi’s
‘puters
News Flash
Attackers don’t care
Limits
Attackers aren’t limited by resources previously learned
Attackers aren’t limited by resources Revision
Attackers aren’t limited
Phone
MIMIC THE REAL
Why Who Where When What PENETRATION TESTING Why
Penetration testing isn’t important
Penetration testing isn’t important to most organizations
Penetration testing doesn’t secure you
Penetration testing tests defenses
required We’ve Convinced Everyone* it’s
TANGENT ALERT
Penetration Testers love to diss vendors
Penetration Testers are vendors
BACK TO YOUR REGULARLY SCHEDULED PROGRAM
Penetration testing proves two things
Penetration testing proves vulnerability One
Penetration testing proves vulnerability adjective One
Penetration testing identifies a few* risky issues Two
Penetration testing identifies a few* risky issues * Actual Results
may vary Two
known and unknown
new exploits aren’t needed
known exploits work
low-hanging fruit
expensive & rare New Exploits
MIMIC THE REAL
When pen testing isn’t stupid
No more defensive ideas
No more low-hanging fruit
Management wants to assess security controls
check&balance
Why Who Where When What < Attackers are unique
Why Who Where When What < Different attack methods
Why Who Where When What < Unlimited by time
Why Who Where When What No Rules of Engagement <
Why Who Where When What < Doesn’t protect you
Penetration Tests don’t mimic real attacks summary
Penetration Tests don’t secure you summary
Penetration Tests test your defenses summary
Thanks.
Brett Hardin http://bretthard.in