cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 
%3CLINGO-SUB%20id%3D%22lingo-sub-377171%22%20slang%3D%22en-US%22%3ESearch%20Spam%20Bot%3F%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-377171%22%20slang%3D%22en-US%22%3E%3CP%3EI'm%20putting%20together%20a%20metrics%20report%20on%20off-season%20activity%20and%20just%20noticed%20that%20our%20community%20search%20was%20rather%20inundated%20with%20junk%20searches%20over%20the%20summer.%20We%20received%20thousands%20of%20searches%20for%20the%20terms%20%22_change_me_%22%20and%20%221%22.%20Of%20course%20many%20were%20unsuccessful%20because%20they%20were%20searching%20from%20specific%20boards%2C%20categories%2C%20etc.%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EAnyone%20else%20experience%20this%20or%20know%20who%20was%20behind%20it%3F%20More%20curiosity%20at%20this%20point%20than%20anything%20as%20I'll%20be%20manually%20adjusting%20the%20search%20results%20to%20remove%20the%20junk.%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EThanks.%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-392449%22%20slang%3D%22en-US%22%3ERe%3A%20Search%20Spam%20Bot%3F%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-392449%22%20slang%3D%22en-US%22%3E%3CP%3EHi%26nbsp%3B%3CA%20href%3D%22https%3A%2F%2Fcommunity.lithium.com%2Ft5%2Fuser%2Fviewprofilepage%2Fuser-id%2F3374%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3E%40Wendy_S%3C%2FA%3E%26nbsp%3B-%26nbsp%3B%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EWe%26nbsp%3Balso%20saw%20another%20-%20much%20smaller%20-%20burst%20of%20this%20spammy%20search%20Nov%2013%20and%2014.%20Seems%20like%20it'll%20be%20a%20recurring%20thing%20until%20there's%20a%20way%20to%26nbsp%3Blimit%20search%20usage%20or%20some%20other%20blocking%20techniques%20for%20anonymous%20users.%20Yuck.%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3ERegards%2C%3C%2FP%3E%3CP%3E-%20Caroline%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-392409%22%20slang%3D%22en-US%22%3ERe%3A%20Search%20Spam%20Bot%3F%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-392409%22%20slang%3D%22en-US%22%3EThanks%2C%20%3CA%20href%3D%22https%3A%2F%2Fcommunity.lithium.com%2Ft5%2Fuser%2Fviewprofilepage%2Fuser-id%2F63194%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3E%40ClaudiusH%3C%2FA%3E!%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-391943%22%20slang%3D%22en-US%22%3ERe%3A%20Search%20Spam%20Bot%3F%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-391943%22%20slang%3D%22en-US%22%3E%3CP%3ESeems%20more%20spam%20is%20coming%20from%20Ashburn.%20%3CA%20href%3D%22https%3A%2F%2Fwww.google.com%2Fsearch%3Fei%3Dw2YNWuDHCsvKwQLMppvAAQ%26amp%3Bq%3DAshburn%2Bspam%26amp%3Boq%3DAshburn%2Bspam%26amp%3Bgs_l%3Dpsy-ab.3..0i22i30k1.6492.7118.0.7482.5.5.0.0.0.0.86.327.5.5.0....0...1.1.64.psy-ab..0.5.327...0j0i203k1j0i67k1.0.FVkbDbCXZB0%22%20target%3D%22_blank%22%20rel%3D%22nofollow%20noopener%20noreferrer%20noopener%20noreferrer%22%3Ehttps%3A%2F%2Fwww.google.com%2Fsearch%3Fei%3Dw2YNWuDHCsvKwQLMppvAAQ%26amp%3Bq%3DAshburn%2Bspam%26amp%3Boq%3DAshburn%2Bspam%26amp%3Bgs_l%3Dpsy-ab.3..0i22i30k1.6492.7118.0.7482.5.5.0.0.0.0.86.327.5.5.0....0...1.1.64.psy-ab..0.5.327...0j0i203k1j0i67k1.0.FVkbDbCXZB0%3C%2FA%3E%3CBR%20%2F%3E%3CBR%20%2F%3EBy%20the%20way%20we%20are%20also%20seeing%20the%20search%20term%20number%201%20in%20our%20search%20results%20but%20only%20recently.%20We've%20had%20another%20issue%20open%20whereby%20a%20specific%20search%20term%20increased%20up%20to%20an%20average%20of%206000.%20The%20numbers%20for%20the%20specific%20search%20term%20are%20very%20very%20high%20and%20very%20unusual%20compared%20to%20our%20historical%20search%20reports%20in%20LSI.%3CBR%20%2F%3ETo%20compare%2C%20the%20nr%202%20search%20terms%20ranges%20from%20600-900%20results....and%20this%20specific%20search%20term%20has%20been%20the%20nr%201%20search%20term%20since%20Maywith%20on%20average%206000%20hits.%3CBR%20%2F%3EWe%20also%20like%20to%20know%20what's%20behind%20this%20number%20since%20it%20is%20unlikely%20to%20be%20representing%20%22customer%22%20traffic.%3CBR%20%2F%3EGood%20luck!%3CBR%20%2F%3EWendy%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-391924%22%20slang%3D%22en-US%22%3ERe%3A%20Search%20Spam%20Bot%3F%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-391924%22%20slang%3D%22en-US%22%3E%3CP%3EThe%20manual%20cleaning%20I%20was%20referring%20to%20is%20exactly%20the%20process%20you%20described%20to%20verify%20and%20remove%20irrelevant%20search%20terms%20and%20then%26nbsp%3Bre-calculate%20percentages%20in%20a%20spreadsheet.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3ECurrently%20there%20is%20no%20way%20to%20limit%20search%20usage%20by%20certain%20criteria.%20Maybe%20it's%20worth%20to%20create%20a%20%22search%20flood%20prevention%22%20funtionality%20similar%20to%20the%20message%20flood%20prevention.%20If%20you%20are%20still%20seeing%20this%20search%20spam%20persisting%20on%20your%20community%20and%20it's%20placing%20a%20burden%20on%20your%20search%20reporting%20I%20suggest%20%3CA%20href%3D%22https%3A%2F%2Fcommunity.lithium.com%2Ft5%2FProduct-Ideas%2Fidb-p%2FLithium_Ideas%22%20target%3D%22_self%22%20rel%3D%22noopener%20noreferrer%22%3Esubmitting%20a%20product%20enhancement%20idea%3C%2FA%3E%20and%20referencing%20this%20discussion.%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-387018%22%20slang%3D%22en-US%22%3ERe%3A%20Search%20Spam%20Bot%3F%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-387018%22%20slang%3D%22en-US%22%3E%3CP%3EAs%20far%20as%20preventing%20this%20in%20the%20future%20-%20is%20there%20any%20way%20to%20limit%20the%20number%20of%20searches%20a%20particular%20IP%20address%20can%20do%20within%20a%20certain%20amount%20of%20time%3F%20It%20looks%20like%20just%20about%20all%20of%20these%20searches%20came%20from%20an%20anonymous%20user%20in%20Ashburn%2C%20VA%2C%20and%20were%20concentrated%20within%20just%20a%20few%20minutes.%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-387000%22%20slang%3D%22en-US%22%3ERe%3A%20Search%20Spam%20Bot%3F%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-387000%22%20slang%3D%22en-US%22%3EThanks%20for%20the%20info%2C%20Jillian!%20I%20was%20hoping%20to%20have%20some%20way%20to%20scrub%20the%20data%20that%20appears%20in%20LSI%2C%20but%20I%20imagine%20that's%20not%20really%20possible.%20I'll%20use%20a%20similar%20offline%20process%20to%20what%20you%20described.%3CBR%20%2F%3E%3CBR%20%2F%3EGlad%20it's%20not%20just%20us%2C%20also!%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-386993%22%20slang%3D%22en-US%22%3ERe%3A%20Search%20Spam%20Bot%3F%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-386993%22%20slang%3D%22en-US%22%3E%3CP%3EGlad%20(in%20a%20weird%20way)%20that%20we're%20not%20alone%20on%20the%20weird%20searches.%20It%20appears%20to%20be%20a%20search%20crawler%20called%20Arachni%2C%20but%20that's%20about%20as%20far%20as%20I%20got%20with%20figuring%20out%20who%2Fwhat%20was%20behind%20the%20inflated%20search%20results.%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EAs%20for%20scrubbing%20search%20results%2C%20we%20exported%20our%20searches%20with%20and%20without%20results%20to%20Excel%2C%20and%20removed%20the%20ones%20that%20said%20_change_me_%2C%201%2C%20Arachni%2C%20or%20some%20variation%20of%20it.%20Then%20we%20summed%20up%20the%20total%20searches%20again%2C%20re-calculated%20successful%20and%20unsuccessful%2C%20and%20that%20was%20that%20(with%20a%20notation%20on%20our%20monthly%20dashboard).%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EEither%20way%2C%20I%20hope%20it%20goes%20away.%20Scrubbing%20results%20takes%20time!%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-386986%22%20slang%3D%22en-US%22%3ERe%3A%20Search%20Spam%20Bot%3F%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-386986%22%20slang%3D%22en-US%22%3E%3CP%3EHi%26nbsp%3B%3CA%20href%3D%22https%3A%2F%2Fcommunity.lithium.com%2Ft5%2Fuser%2Fviewprofilepage%2Fuser-id%2F63194%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3E%40ClaudiusH%3C%2FA%3E%26nbsp%3B-%26nbsp%3B%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EWe've%20also%20seen%20this%20problem%20-%20we%20got%20hit%20with%26nbsp%3Bsome%20sort%20of%20automated%20search%20bot%26nbsp%3Baround%20Oct%2020%2C%20and%20it's%20making%20our%20reports%20look%20sort%20of%20crazy.%20See%20screenshot%20for%20more%20context.%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EYou%20mention%20manually%20cleaning%20up%20the%20report%20-%20how%20would%20I%20do%20this%3F%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3ECheers!%3CBR%20%2F%3E-%20Caroline%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20style%3D%22width%3A%20400px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Fcommunity.lithium.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F104715i1F7F447E71020DA2%2Fimage-size%2Fmedium%3Fv%3D1.0%26amp%3Bpx%3D400%22%20srcset%3D%22%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F104715i1F7F447E71020DA2%2Fimage-size%2Fmedium%3Fv%3D1.0%26amp%3Bpx%3D400%201.0x%22%20alt%3D%22image.png%22%20title%3D%22image.png%22%20%2F%3E%3C%2FSPAN%3E%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EThanks!%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-378124%22%20slang%3D%22en-US%22%3ERe%3A%20Search%20Spam%20Bot%3F%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-378124%22%20slang%3D%22en-US%22%3E%3CP%3EFeeling%20left%20out%20since%20here%20on%20the%20Lithium%20Community%20we%20haven't%20seen%20such%20searches%20since%20June%202017%20%3Cspan%20class%3D%22lia-unicode-emoji%22%20title%3D%22%3Aslightly_frowning_face%3A%22%3E%F0%9F%99%81%3C%2Fspan%3E%3C%2FP%3E%0A%3CP%3E%3CBR%20%2F%3ENormally%20the%20explanation%20for%20many%20of%20these%20odd%20search%20terms%20are%20related%20to%20UX.%20E.g.%20community%20members%20are%20searching%20for%20other%20members%20using%20the%20content%20search%2C%20they%20are%20searching%20for%20a%20community%20setting%20using%20search%20or%20the%20search%20scope%20is%20too%20narrow%20within%20a%20community%20sub-node%20to%20actually%20yield%20results.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CSTRONG%3EBut%3A%3C%2FSTRONG%3E%20The%20fact%20that%20you%20are%20seeing%20this%20across%20different%20communities%20suggests%20indeed%20suggests%20some%20automated%20entity%20to%20be%20at%20work.%20This%20could%20be%20a%20script%20verifying%20that%20spam%20content%20actually%20made%20it%20to%20the%20community%20or%20a%20content%20scraper%20that%20went%20rogue.%20The%20best%20way%20to%20deal%20with%20these%20anomalies%20indeed%26nbsp%3Bis%20to%20manually%20clean%20up%20the%20report.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EShould%20they%20be%20persisting%20you%20could%20try%20to%20identify%20and%20lock%20out%20these%20visitors.%20If%20that's%20worth%20the%20effort%20depends%20on%20whether%20their%20visits%20are%20just%20a%20nuisance%20or%20they%20are%20causing%20a%20lot%20of%20traffic.%20To%20identify%20these%20users%20you%20would%20use%20your%20web%20analytics%20tool%20to%20look%20at%20high%20traffic%20volumes%20from%20individual%20IPs.%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-377372%22%20slang%3D%22en-US%22%3ERe%3A%20Search%20Spam%20Bot%3F%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-377372%22%20slang%3D%22en-US%22%3E%3CP%3EI%20also%20have%20%22%3CSPAN%3E_change_me_%22%20as%20the%20highest%20unsuccessful%20search%20term%20in%20my%20Community%2C%20by%20several%20orders%20of%20magnitude.%26nbsp%3B%3C%2FSPAN%3E%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3E%3CSPAN%3EStrange.%3C%2FSPAN%3E%3C%2FP%3E%3C%2FLINGO-BODY%3E
Highlighted
Esteemed Contributor

Search Spam Bot?

I'm putting together a metrics report on off-season activity and just noticed that our community search was rather inundated with junk searches over the summer. We received thousands of searches for the terms "_change_me_" and "1". Of course many were unsuccessful because they were searching from specific boards, categories, etc.

 

Anyone else experience this or know who was behind it? More curiosity at this point than anything as I'll be manually adjusting the search results to remove the junk.

 

Thanks.

Jillian Bejtlich
Community Architect
The Community Roundtable
10 Replies 10
Highlighted
Honored Contributor

Hi @Wendy_S - 

 

We also saw another - much smaller - burst of this spammy search Nov 13 and 14. Seems like it'll be a recurring thing until there's a way to limit search usage or some other blocking techniques for anonymous users. Yuck.

 

Regards,

- Caroline