Human Generated Data

Title

Untitled (man standing on platform in crowded drug store)

Date

c. 1947

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7303

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (man standing on platform in crowded drug store)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1947

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Human 97.9
Person 97.5
Crowd 97.5
Person 95.3
Audience 94.7
Person 91.8
Person 89.7
People 85.9
Person 83.8
Person 82.6
Person 79.5
Person 66.6
Building 62
Parade 60.4
Person 60.3
Person 60.3
Person 59.3
Festival 56.2
Person 52.9

Imagga
created on 2022-01-15

city 27.4
shop 23.4
business 17.6
urban 15.7
people 15
mercantile establishment 14.8
building 13.9
stall 13
man 12.2
travel 12
modern 11.9
stage 11.7
male 11.3
old 11.1
art 10.8
pattern 10.2
architecture 10.1
black 9.6
place of business 9.5
buildings 9.4
men 9.4
town 9.3
world 9.2
design 9
new 8.9
person 8.7
aerial 8.7
scene 8.6
crowd 8.6
shoe shop 8.4
texture 8.3
street 8.3
tourism 8.2
human 8.2
life 8.2
spectator 8.2
retro 8.2
supermarket 8.2
technology 8.2
adult 8
station 8
market 8
work 7.9
line 7.7
industry 7.7
room 7.7
sky 7.6
customer 7.6
cityscape 7.6
clothing 7.5
horizontal 7.5
contemporary 7.5
landscape 7.4
industrial 7.3
group 7.2
musician 7.2
tower 7.2
singer 7.1
science 7.1
surface 7

Google
created on 2022-01-15

Microsoft
created on 2022-01-15

person 98.1
text 96.1
outdoor 86
people 77.2
group 70.1
outdoor object 61.9
black and white 59
crowd 56.3
posing 41.5

Face analysis

Amazon

AWS Rekognition

Age 39-47
Gender Female, 61.8%
Calm 50.3%
Happy 31.2%
Sad 12.4%
Angry 1.6%
Disgusted 1.5%
Surprised 1.4%
Fear 0.9%
Confused 0.7%

AWS Rekognition

Age 22-30
Gender Male, 94.9%
Happy 94.9%
Angry 2.3%
Calm 0.8%
Fear 0.7%
Surprised 0.6%
Sad 0.4%
Disgusted 0.2%
Confused 0.1%

AWS Rekognition

Age 37-45
Gender Male, 98.4%
Sad 49%
Happy 29.7%
Surprised 9.6%
Calm 6.2%
Fear 3%
Angry 1.1%
Confused 0.8%
Disgusted 0.7%

AWS Rekognition

Age 21-29
Gender Male, 82%
Happy 82.1%
Calm 7.7%
Sad 4.7%
Angry 2%
Disgusted 1.2%
Surprised 1%
Confused 0.7%
Fear 0.4%

AWS Rekognition

Age 21-29
Gender Female, 96.2%
Happy 89.9%
Calm 6.6%
Angry 1%
Sad 0.9%
Surprised 0.5%
Fear 0.5%
Disgusted 0.4%
Confused 0.2%

AWS Rekognition

Age 22-30
Gender Male, 98%
Happy 93.8%
Calm 2.2%
Sad 1.6%
Surprised 0.8%
Fear 0.6%
Confused 0.5%
Angry 0.3%
Disgusted 0.2%

AWS Rekognition

Age 23-33
Gender Male, 93.5%
Happy 97.8%
Calm 0.8%
Surprised 0.4%
Sad 0.3%
Angry 0.2%
Fear 0.2%
Confused 0.1%
Disgusted 0.1%

AWS Rekognition

Age 25-35
Gender Male, 94.8%
Sad 59.9%
Calm 15.8%
Happy 8.6%
Angry 8.5%
Fear 4.4%
Disgusted 1%
Confused 0.9%
Surprised 0.9%

AWS Rekognition

Age 25-35
Gender Male, 98.2%
Happy 61.3%
Fear 18.7%
Calm 11%
Surprised 3.5%
Sad 3%
Angry 1.5%
Disgusted 0.6%
Confused 0.4%

AWS Rekognition

Age 11-19
Gender Male, 74.3%
Calm 83.2%
Happy 11.3%
Sad 2.4%
Disgusted 0.8%
Angry 0.7%
Surprised 0.6%
Fear 0.5%
Confused 0.3%

AWS Rekognition

Age 28-38
Gender Female, 50.7%
Calm 52.7%
Happy 27.6%
Sad 14.3%
Surprised 1.5%
Confused 1.3%
Fear 1.1%
Angry 0.8%
Disgusted 0.8%

AWS Rekognition

Age 43-51
Gender Male, 93.8%
Calm 94.4%
Happy 2.6%
Sad 1.7%
Angry 0.3%
Confused 0.3%
Disgusted 0.3%
Surprised 0.2%
Fear 0.2%

AWS Rekognition

Age 25-35
Gender Male, 96%
Calm 74.5%
Happy 8%
Fear 6.2%
Sad 5.4%
Disgusted 2.4%
Angry 1.5%
Surprised 1.1%
Confused 0.8%

AWS Rekognition

Age 13-21
Gender Female, 52%
Sad 29.6%
Happy 23.9%
Fear 15.8%
Surprised 14.3%
Calm 10.2%
Angry 3.5%
Disgusted 1.9%
Confused 0.9%

AWS Rekognition

Age 36-44
Gender Male, 94.9%
Sad 69.5%
Happy 13.9%
Calm 13.8%
Confused 1%
Surprised 0.6%
Angry 0.5%
Fear 0.5%
Disgusted 0.2%

AWS Rekognition

Age 23-33
Gender Female, 95.7%
Happy 99.6%
Sad 0.1%
Surprised 0.1%
Angry 0.1%
Calm 0.1%
Disgusted 0%
Fear 0%
Confused 0%

AWS Rekognition

Age 22-30
Gender Male, 51.5%
Happy 27.3%
Sad 23%
Fear 21.8%
Calm 18.3%
Angry 4.4%
Disgusted 2.5%
Confused 1.4%
Surprised 1.3%

AWS Rekognition

Age 24-34
Gender Male, 96.6%
Calm 46.1%
Sad 25%
Happy 22.9%
Angry 2.2%
Confused 1.6%
Fear 0.9%
Disgusted 0.8%
Surprised 0.6%

AWS Rekognition

Age 28-38
Gender Male, 89.5%
Calm 95.4%
Sad 1.4%
Surprised 0.8%
Angry 0.7%
Happy 0.6%
Confused 0.4%
Disgusted 0.4%
Fear 0.3%

AWS Rekognition

Age 23-31
Gender Female, 81.7%
Happy 86.5%
Calm 3.4%
Fear 3%
Confused 2.3%
Sad 1.8%
Surprised 1.2%
Angry 1.1%
Disgusted 0.7%

AWS Rekognition

Age 23-33
Gender Male, 96.4%
Happy 85.5%
Calm 9.9%
Sad 1.7%
Angry 0.9%
Surprised 0.8%
Confused 0.6%
Disgusted 0.3%
Fear 0.3%

AWS Rekognition

Age 22-30
Gender Female, 82.2%
Calm 59.2%
Happy 28.6%
Sad 4.9%
Disgusted 2.2%
Angry 1.9%
Fear 1.4%
Surprised 0.9%
Confused 0.9%

AWS Rekognition

Age 27-37
Gender Male, 98.3%
Calm 94.1%
Sad 3.1%
Happy 1%
Surprised 0.5%
Fear 0.5%
Angry 0.4%
Disgusted 0.3%
Confused 0.1%

AWS Rekognition

Age 22-30
Gender Male, 99.7%
Calm 92.6%
Happy 3.1%
Surprised 1.4%
Sad 1.4%
Angry 0.5%
Fear 0.4%
Confused 0.3%
Disgusted 0.3%

AWS Rekognition

Age 28-38
Gender Male, 75.7%
Calm 48.7%
Sad 18%
Happy 16.2%
Fear 8.2%
Surprised 5.1%
Angry 1.8%
Confused 1.1%
Disgusted 0.9%

AWS Rekognition

Age 13-21
Gender Female, 66.7%
Calm 82.3%
Sad 9.1%
Happy 5.9%
Fear 0.8%
Angry 0.6%
Confused 0.6%
Surprised 0.5%
Disgusted 0.4%

AWS Rekognition

Age 36-44
Gender Male, 80.6%
Calm 74.9%
Sad 14%
Happy 3.9%
Fear 2.4%
Angry 2.4%
Confused 1.2%
Disgusted 0.8%
Surprised 0.5%

AWS Rekognition

Age 34-42
Gender Male, 99.3%
Happy 89.4%
Calm 8.6%
Surprised 0.6%
Sad 0.4%
Confused 0.3%
Angry 0.3%
Fear 0.2%
Disgusted 0.2%

AWS Rekognition

Age 21-29
Gender Male, 96.2%
Happy 65.7%
Fear 15.6%
Sad 13.2%
Calm 2%
Surprised 1.9%
Angry 1%
Confused 0.4%
Disgusted 0.3%

AWS Rekognition

Age 29-39
Gender Male, 99.1%
Calm 62%
Happy 26.8%
Surprised 5%
Fear 2.5%
Disgusted 1.6%
Sad 0.9%
Angry 0.8%
Confused 0.4%

AWS Rekognition

Age 14-22
Gender Male, 99.4%
Calm 94.2%
Sad 3.6%
Angry 0.7%
Happy 0.5%
Fear 0.4%
Confused 0.2%
Surprised 0.2%
Disgusted 0.2%

Feature analysis

Amazon

Person 97.5%

Captions

Microsoft

a group of people standing in front of a crowd 90.5%
a group of people standing in front of a crowd posing for the camera 87.1%
a group of people posing for a photo in front of a crowd 87%

Text analysis

Amazon

KEY,
23312
SIESTA
J.
FLOOR
SECOND
BRUSHES
SARASOTA,
UCE
SUNDRIES
FLAS
J. J. STEINMETZ. SIESTA KEY, SARASOTA, FLAS
OPTICAL
APPLIANCES
6
DRUG
LUGGAGE
15
STEINMETZ.
non
ZIEEZ
FLOOR DEPT.

Google

SECOND FLOOR ROOR DEPT. 23312 J. J. STEINMETZ, SIESTA KEY, SARASOTA, FLA:
ROOR
23312
STEINMETZ,
SARASOTA,
J.
SIESTA
KEY,
FLOOR
FLA:
SECOND
DEPT.