Human Generated Data

Title

Men at auction room, Pickaway Livestock Cooperative Association

Date

1938

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3120

Human Generated Data

Title

Men at auction room, Pickaway Livestock Cooperative Association

People

Artist: Ben Shahn, American 1898 - 1969

Date

1938

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Human 99.5
Crowd 99.5
Audience 99.5
Person 99.5
Person 99.3
Person 99.1
Person 98.6
Clothing 97.5
Apparel 97.5
Person 96.8
Person 96.3
Person 95.5
Person 95.4
Person 94
Person 92.9
Person 90.7
Person 90.6
Person 88.7
Person 85.4
Sitting 84.6
People 70.6
Person 67.8
Hat 67.7
Person 67.7
Helmet 66.6
Press Conference 65.4
Speech 59.6

Imagga
created on 2021-12-15

person 35
man 33.6
home 27.9
barbershop 27.7
male 27
people 25.6
senior 23.4
indoors 21.9
room 21.5
shop 21
men 20.6
adult 20
patient 18.7
couple 17.4
mercantile establishment 16.6
happy 16.3
sitting 15.4
mature 13.9
old 13.9
smiling 13.7
retired 13.6
professional 13.4
elderly 13.4
planner 13.1
smile 12.8
computer 12
inside 12
indoor 11.9
older 11.6
office 11.3
place of business 11.2
aged 10.8
family 10.7
medical 10.6
retirement 10.6
talking 10.4
lifestyle 10.1
occupation 10.1
horizontal 10
grandfather 9.8
cheerful 9.7
interior 9.7
brass 9.4
casual 9.3
child 9.2
stretcher 9.2
chair 9.2
case 9.1
business 9.1
care 9
wind instrument 9
nurse 9
health 9
group 8.9
working 8.8
together 8.8
couch 8.7
table 8.6
happiness 8.6
hospital 8.4
portrait 8.4
communication 8.4
laptop 8.3
fun 8.2
sick person 8.2
surgeon 8.2
handsome 8
looking 8
two people 7.8
break 7.6
husband 7.6
two 7.6
resting 7.6
enjoying 7.6
meeting 7.5
doctor 7.5
father 7.5
vintage 7.4
phone 7.4
litter 7.3
alone 7.3
relaxing 7.3
mother 7.2
cornet 7.2
women 7.1
love 7.1
businessman 7.1

Google
created on 2021-12-15

Shirt 93.8
Hat 87.4
Style 83.9
Black-and-white 82.6
Headgear 81.6
Monochrome 76.2
Monochrome photography 75.6
Event 72.8
Crew 72.5
Crowd 72
Suit 70.7
Room 68.6
Vintage clothing 66.9
Team 66.1
Stock photography 62.6
Photo caption 60.1
Sitting 59.8
Public transport 59.3
Cap 59.2
History 58.6

Microsoft
created on 2021-12-15

person 99.9
clothing 98.9
man 97
text 96.8
group 74
human face 73
old 52
crowd 8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 36-54
Gender Male, 80.9%
Calm 95.9%
Happy 2.8%
Angry 0.5%
Disgusted 0.3%
Sad 0.2%
Surprised 0.2%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 23-35
Gender Male, 96.3%
Calm 93.6%
Surprised 1.7%
Fear 1.2%
Confused 0.9%
Angry 0.8%
Happy 0.8%
Sad 0.7%
Disgusted 0.3%

AWS Rekognition

Age 36-54
Gender Male, 92.5%
Calm 97.8%
Sad 1.2%
Confused 0.3%
Happy 0.2%
Surprised 0.2%
Angry 0.2%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 34-50
Gender Male, 98.3%
Calm 88.7%
Confused 3.2%
Sad 2%
Fear 2%
Angry 1.9%
Surprised 1.4%
Happy 0.7%
Disgusted 0.3%

AWS Rekognition

Age 29-45
Gender Male, 98.5%
Calm 99%
Sad 0.7%
Confused 0.2%
Surprised 0.1%
Angry 0%
Fear 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 6-16
Gender Female, 82.3%
Calm 91%
Sad 2.7%
Fear 2.6%
Confused 1.5%
Surprised 1.2%
Angry 0.6%
Happy 0.3%
Disgusted 0.2%

AWS Rekognition

Age 38-56
Gender Male, 94.3%
Calm 98.9%
Sad 0.5%
Happy 0.4%
Angry 0.1%
Surprised 0%
Confused 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 40-58
Gender Male, 61.4%
Calm 65%
Angry 21.8%
Happy 6.5%
Sad 3.4%
Fear 1.4%
Surprised 1.2%
Confused 0.5%
Disgusted 0.3%

AWS Rekognition

Age 37-55
Gender Male, 88%
Surprised 40.1%
Fear 29.9%
Calm 15.3%
Angry 13.5%
Happy 1%
Sad 0.1%
Confused 0.1%
Disgusted 0%

AWS Rekognition

Age 23-35
Gender Male, 93.5%
Calm 97.2%
Sad 1.1%
Happy 1%
Angry 0.2%
Confused 0.2%
Surprised 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 19-31
Gender Male, 72.3%
Calm 92.1%
Happy 6.5%
Sad 0.8%
Confused 0.2%
Disgusted 0.1%
Angry 0.1%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 25-39
Gender Male, 63.1%
Calm 94%
Happy 5.6%
Sad 0.3%
Surprised 0%
Angry 0%
Confused 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 36-54
Gender Female, 90.5%
Sad 83.2%
Calm 13.3%
Angry 1%
Happy 1%
Confused 0.7%
Fear 0.4%
Surprised 0.3%
Disgusted 0.2%

AWS Rekognition

Age 20-32
Gender Female, 76.7%
Calm 98%
Happy 1.3%
Surprised 0.2%
Sad 0.2%
Angry 0.1%
Disgusted 0.1%
Fear 0.1%
Confused 0%

AWS Rekognition

Age 26-42
Gender Female, 62.2%
Calm 29.8%
Fear 25.3%
Confused 15%
Sad 12.7%
Disgusted 5.1%
Happy 5%
Surprised 4.6%
Angry 2.4%

AWS Rekognition

Age 33-49
Gender Female, 78.9%
Calm 95.9%
Sad 3%
Happy 0.3%
Confused 0.3%
Surprised 0.2%
Angry 0.2%
Fear 0.1%
Disgusted 0%

Microsoft Cognitive Services

Age 11
Gender Male

Microsoft Cognitive Services

Age 35
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Feature analysis

Amazon

Person 99.5%
Helmet 66.6%

Captions

Microsoft

a group of people posing for a photo 91.3%
a group of people sitting posing for the camera 91.2%
a group of people sitting in front of a crowd 91.1%