I sat in a room full of corporate executives as the CFO of a small tech company gave a presentation about how they collected data on individuals from open sources then used that data to build (calculate, really) a list of 150 characteristics about each person. He proceeded to show a variety of charts about the employees of each of these companies whose executives were sitting in the room: how many went to what school, all sorts of demographic info, salaries, etc.
He was using a pretty nifty data visualization tool to scroll through data points and drill in and out of various charts. His aim was to sell this data and the graphics were fairly stunning. There were all sorts of use cases for knowing all kinds of shit about people. It wasn't long before the tough questions started. First were questions about the tech involved, and then about the quality of those 150 data points.
He would not divulge what specific technologies, algorithms, or any methods at all that they used. He only said that they scraped every source that they were legally allowed to and plugged that data into their algorithms. They used whatever popular hosting platform suited them at the moment: AWS, Azure, Sungard... and that they regularly switch platforms for reasons he would not disclose. He said they could move from one platform to the next within 48 hours and for very little cost, something that would take any CIO sitting in the room months and millions of dollars to do. He actually took a shot at big company technology in a way that I thought was insulting.
Such secrecy caused a lot of doubt about what sort of hocus pocus this company performed. The presenter let the doubt build to the point I thought his presentation was bordering on total failure.
He asked the audience to shout out a list of characteristics of someone they would like to find and a geographic location. A few job skills were called out, a particular city center was mentioned, and he was drilling down on these things at conversational speed. In a few moments he had a few subjects on the screen and a lot of information about them includes photos.
Then he asked if anyone would like to have him drill down into their company to get some detail on their employees.
And shit got real...
One executive volunteered. The presenter pivoted to his company and it wasn't long before he zeroed in on the executive himself. The presenter knew so much shit that the exec was visibly uncomfortable... the data was not just about him at work, but about his family, friends, social life, musical preferences, how he voted, culinary like/dislikes, and on and on. The executive demanded he stop. Two other people volunteered, as he zoomed in on one lady, pulled up her pictures from all over the web, what websites she visited, her several email addresses, and all sorts of things she posted under various screen names, she demanded he stop, and the other person did not allow him to even get started.
As for much of what they imputed it was asked how they knew they were right. Turns out they do projects for agencies like the NSA who have everything that would be illegal for this firm to gather. They were able to validate their algorithms.
These guys built this system not for nefarious purposes but to get rich. It will undoubtedly be used for evil.
Recalling the many warnings of @lowlight , be careful. There are several members here who have given similar warnings and know what they are talking about. Listen up.
EDIT: I am not demonizing these guys. They are above board and hold themselves accountable for privacy laws beyond what the law requires. I am impressed as can be by their work, and I think they deserve their eventual ma$$ive payout.
The onus of self-protection is on us. SH is but one of many examples of us exposing ourselves to the web. Caveat Emptor.
He was using a pretty nifty data visualization tool to scroll through data points and drill in and out of various charts. His aim was to sell this data and the graphics were fairly stunning. There were all sorts of use cases for knowing all kinds of shit about people. It wasn't long before the tough questions started. First were questions about the tech involved, and then about the quality of those 150 data points.
He would not divulge what specific technologies, algorithms, or any methods at all that they used. He only said that they scraped every source that they were legally allowed to and plugged that data into their algorithms. They used whatever popular hosting platform suited them at the moment: AWS, Azure, Sungard... and that they regularly switch platforms for reasons he would not disclose. He said they could move from one platform to the next within 48 hours and for very little cost, something that would take any CIO sitting in the room months and millions of dollars to do. He actually took a shot at big company technology in a way that I thought was insulting.
Such secrecy caused a lot of doubt about what sort of hocus pocus this company performed. The presenter let the doubt build to the point I thought his presentation was bordering on total failure.
He asked the audience to shout out a list of characteristics of someone they would like to find and a geographic location. A few job skills were called out, a particular city center was mentioned, and he was drilling down on these things at conversational speed. In a few moments he had a few subjects on the screen and a lot of information about them includes photos.
Then he asked if anyone would like to have him drill down into their company to get some detail on their employees.
And shit got real...
One executive volunteered. The presenter pivoted to his company and it wasn't long before he zeroed in on the executive himself. The presenter knew so much shit that the exec was visibly uncomfortable... the data was not just about him at work, but about his family, friends, social life, musical preferences, how he voted, culinary like/dislikes, and on and on. The executive demanded he stop. Two other people volunteered, as he zoomed in on one lady, pulled up her pictures from all over the web, what websites she visited, her several email addresses, and all sorts of things she posted under various screen names, she demanded he stop, and the other person did not allow him to even get started.
As for much of what they imputed it was asked how they knew they were right. Turns out they do projects for agencies like the NSA who have everything that would be illegal for this firm to gather. They were able to validate their algorithms.
These guys built this system not for nefarious purposes but to get rich. It will undoubtedly be used for evil.
Recalling the many warnings of @lowlight , be careful. There are several members here who have given similar warnings and know what they are talking about. Listen up.
EDIT: I am not demonizing these guys. They are above board and hold themselves accountable for privacy laws beyond what the law requires. I am impressed as can be by their work, and I think they deserve their eventual ma$$ive payout.
The onus of self-protection is on us. SH is but one of many examples of us exposing ourselves to the web. Caveat Emptor.
Last edited: