Human Generated Data

Title

Untitled (man and woman dressed as kind and queen seated on platform)
Date

c. 1950
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5574
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (man and woman dressed as kind and queen seated on platform)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 99.5
Human 99.5
Person 99.3
Clothing 99.2
Apparel 99.2
Person 98.1
Person 97.9
Furniture 97.8
Person 97
Person 96.3
Person 92.3
Person 92.3
Person 89
Accessory 88.4
Accessories 88.4
Sunglasses 88.4
Person 86.1
Person 76.1
Person 74
Text 68.8
Female 68.5
Person 67.8
Person 64.8
People 63.1
Hat 59.5
Overcoat 59.4
Coat 59.4
Bar Stool 58.5
Suit 58.4
Shorts 58.2
Woman 55.9

Imagga
created on 2021-12-14

person 33.7
man 33.6
people 31.8
male 30.5
adult 27.6
professional 26.2
office 25.9
room 25.6
businessman 23.8
work 23.8
smiling 23.1
business 23.1
patient 22.3
worker 21.5
men 21.5
medical 20.3
happy 20.1
desk 19.8
sitting 19.8
hospital 19.4
hairdresser 18.8
colleagues 18.5
table 18.3
businesswoman 18.2
doctor 17.9
indoors 17.6
team 17
group 16.9
job 16.8
mature 16.7
women 16.6
corporate 16.3
working 15.9
teacher 15.5
clothing 15.4
nurse 15.3
businesspeople 15.2
meeting 15.1
smile 15
portrait 14.2
health 13.9
home 13.6
couple 13.1
occupation 12.8
computer 12.8
life 12.7
modern 12.6
interior 12.4
talking 12.4
chair 12.3
lifestyle 12.3
together 12.3
education 12.1
coat 12
casual 11.9
associates 11.8
happiness 11.8
barbershop 11.7
color 11.7
cheerful 11.4
teamwork 11.1
day 11
indoor 11
lab coat 10.9
communication 10.9
coworkers 10.8
face 10.7
30s 10.6
medicine 10.6
shop 10.4
manager 10.2
20s 10.1
laptop 10
attractive 9.8
educator 9.8
classroom 9.8
conference 9.8
vestment 9.7
looking 9.6
senior 9.4
clinic 9.3
care 9.1
board 9
suit 9
human 9
surgeon 8.9
40s 8.8
standing 8.7
gown 8.7
specialist 8.6
adults 8.5
two 8.5
musical instrument 8.4
practitioner 8.4
treatment 8.3
salon 8.3
confident 8.2
to 8
scientist 7.8
executive 7.8
mid adult 7.7
laboratory 7.7
four 7.7
hand 7.6
mercantile establishment 7.5
clothes 7.5
holding 7.4
case 7.3
success 7.2
bright 7.1
student 7.1
family 7.1

Google
created on 2021-12-14

Trousers 96.7
Outerwear 95.1
Photograph 94.1
Hat 90.8
Art 77.9
Vintage clothing 75
Ladder 73.5
Crew 73.5
Monochrome 72.5
Sun hat 72.5
Illustration 71.8
Workwear 69.8
Stool 69.5
Monochrome photography 69.3
Room 69.1
Blue-collar worker 68.2
Uniform 66.1
Stock photography 65.1
History 62.4
Suit 60.9

Microsoft
created on 2021-12-14

person 98.1
text 94.5
clothing 84.7
man 80.7
group 69
drawing 66.2
white 65.6
sketch 64.6
old 40

Face analysis

Amazon

Google

AWS Rekognition

Age 22-34
Gender Male, 96.1%
Disgusted 60.3%
Calm 23.3%
Sad 6.4%
Surprised 3.4%
Angry 2.3%
Fear 1.9%
Confused 1.3%
Happy 1%

AWS Rekognition

Age 19-31
Gender Female, 91.4%
Happy 55.2%
Sad 27.7%
Calm 10.9%
Angry 2.5%
Confused 1.5%
Disgusted 0.8%
Fear 0.7%
Surprised 0.7%

AWS Rekognition

Age 22-34
Gender Male, 65.9%
Calm 88.6%
Sad 5.7%
Confused 3.8%
Surprised 1.3%
Angry 0.3%
Happy 0.1%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 47-65
Gender Male, 77.9%
Calm 89.8%
Happy 6.9%
Surprised 1.6%
Sad 0.7%
Confused 0.5%
Angry 0.2%
Disgusted 0.2%
Fear 0%

AWS Rekognition

Age 39-57
Gender Male, 96.1%
Calm 99.2%
Angry 0.2%
Surprised 0.2%
Happy 0.2%
Sad 0.1%
Disgusted 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 37-55
Gender Male, 87.8%
Happy 70.5%
Calm 26.9%
Surprised 1.1%
Sad 0.5%
Fear 0.3%
Confused 0.3%
Angry 0.3%
Disgusted 0.2%

AWS Rekognition

Age 49-67
Gender Male, 62%
Sad 70%
Calm 15.5%
Confused 11.1%
Surprised 1.7%
Fear 0.7%
Angry 0.5%
Happy 0.2%
Disgusted 0.2%

AWS Rekognition

Age 56-74
Gender Male, 95%
Calm 65.1%
Sad 24.5%
Confused 5.6%
Surprised 1.9%
Fear 1.2%
Happy 0.9%
Angry 0.6%
Disgusted 0.2%

AWS Rekognition

Age 48-66
Gender Female, 77.1%
Happy 48.4%
Calm 35.4%
Sad 11.6%
Angry 2%
Fear 1.3%
Surprised 0.4%
Confused 0.4%
Disgusted 0.4%

AWS Rekognition

Age 3-9
Gender Male, 70%
Calm 72.3%
Sad 24%
Happy 2.4%
Fear 0.6%
Confused 0.3%
Angry 0.3%
Disgusted 0.2%
Surprised 0.1%

AWS Rekognition

Age 33-49
Gender Female, 86.8%
Happy 41.6%
Sad 20.5%
Calm 14.8%
Angry 7.7%
Fear 7.4%
Surprised 4.5%
Confused 2.8%
Disgusted 0.7%

AWS Rekognition

Age 42-60
Gender Male, 92.7%
Calm 67%
Sad 25.1%
Happy 3.3%
Surprised 1.7%
Angry 1%
Confused 1%
Disgusted 0.6%
Fear 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Sunglasses 88.4%

Captions

Microsoft

a group of people posing for a photo 89.9%
a group of people posing for the camera 89.8%
a group of people in an old photo of a man 86.7%

Text analysis

Amazon

22653

Google

22653
22653