Human Generated Data

Title

Untitled (formally dressed seated men and women looking to their left)
Date

c. 1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5641
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (formally dressed seated men and women looking to their left)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Apparel 99.9
Clothing 99.9
Person 98.8
Human 98.8
Person 98.6
Person 98.6
Person 98.5
Person 98.4
Person 97.7
Person 97.7
Person 97.4
Person 96.4
Person 96.3
Person 95
Person 93.3
Person 92.3
Person 91.9
Person 89.8
Person 89.3
Person 88.9
Fashion 88.4
Robe 88.4
Gown 85.8
Wedding 83.2
Accessories 82.4
Accessory 82.4
Sunglasses 82.4
Coat 77.7
Person 77
People 76.5
Sunglasses 74.9
Overcoat 72.9
Suit 72.9
Crowd 72.1
Wedding Gown 71.3
Person 66
Bridegroom 63.9
Person 63.7
Portrait 61.5
Photography 61.5
Photo 61.5
Face 61.5
Shirt 58.5
Bride 58.2
Text 56.6

Imagga
created on 2021-12-15

businessman 47.6
business 41.9
male 41.1
man 39.7
team 36.7
group 36.2
people 35.7
meeting 34.8
person 33.1
brass 32.9
professional 32.4
job 31.8
teamwork 29.6
businesswoman 26.3
work 25.9
happy 25.7
wind instrument 25.7
office 24.9
colleagues 24.3
businesspeople 23.7
corporate 22.3
cornet 22
adult 21.7
men 21.5
worker 20.6
manager 19.5
smiling 18.8
room 18.8
executive 17.9
success 17.7
musical instrument 17.1
nurse 17.1
working 16.8
company 16.7
suit 16.2
desk 16.1
successful 15.5
smile 15
associates 14.7
table 14.7
cooperation 14.5
talking 14.3
medical 14.1
together 14
coworkers 13.7
discussion 13.6
four 13.4
doctor 13.1
new 13
discussing 12.8
laptop 12.7
conference 12.7
30s 12.5
diversity 12.5
cheerful 12.2
mature 12.1
20s 11.9
occupation 11.9
women 11.9
employee 11.8
40s 11.7
life 11.5
career 11.4
modern 11.2
looking 11.2
teacher 11.2
portrait 11
confident 10.9
communication 10.9
handsome 10.7
workers 10.7
ethnic 10.5
plan 10.4
sitting 10.3
presentation 10.2
casual 10.2
two 10.2
finance 10.1
lifestyle 10.1
hospital 9.7
uniform 9.7
architect 9.6
building 9.6
partnership 9.6
boss 9.6
staff 9.6
patient 9.1
indoor 9.1
engineer 9
classroom 9
computer 8.8
indoors 8.8
couple 8.7
partner 8.7
coat 8.5
tie 8.5
health 8.3
camera 8.3
technology 8.2
interior 8
business meeting 7.9
business people 7.9
collaboration 7.9
stethoscope 7.8
client 7.8
diverse 7.8
standing 7.8
businessmen 7.8
lab coat 7.8
builder 7.7
designer 7.7
employment 7.7
leader 7.7
planning 7.7
chart 7.6
senior 7.5
ideas 7.5
hall 7.4
clinic 7.4

Google
created on 2021-12-15

Photograph 94.2
White 92.2
Black 89.7
Black-and-white 84.3
Style 83.9
Crowd 80.8
Font 79.4
Adaptation 79.3
Art 76.9
Snapshot 74.3
Monochrome photography 72.6
Event 72.6
Crew 71.8
Monochrome 71.2
Eyewear 70.4
Hat 69.3
Vintage clothing 68.4
History 68.2
Illustration 64.8
Suit 64.7

Microsoft
created on 2021-12-15

text 99.5
clothing 97.4
person 95.5
man 95
woman 75.7
crowd 0.6

Face analysis

Amazon

Google

AWS Rekognition

Age 23-37
Gender Male, 96.8%
Calm 55.4%
Confused 19.8%
Surprised 19.5%
Sad 2.3%
Happy 1.2%
Angry 1.1%
Fear 0.5%
Disgusted 0.3%

AWS Rekognition

Age 32-48
Gender Male, 90.6%
Calm 53.9%
Surprised 32.7%
Happy 7.6%
Confused 1.8%
Fear 1.4%
Sad 1.1%
Angry 1.1%
Disgusted 0.4%

AWS Rekognition

Age 49-67
Gender Female, 74%
Calm 97.2%
Sad 1.5%
Happy 0.5%
Confused 0.5%
Surprised 0.1%
Angry 0.1%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 47-65
Gender Female, 80.6%
Calm 94.8%
Sad 4.7%
Surprised 0.1%
Confused 0.1%
Angry 0.1%
Happy 0.1%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 45-63
Gender Female, 66.2%
Calm 97.4%
Sad 1.1%
Happy 0.7%
Surprised 0.4%
Angry 0.2%
Confused 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 22-34
Gender Female, 83%
Calm 79.3%
Sad 14.4%
Surprised 2.5%
Angry 2%
Confused 1.4%
Fear 0.2%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 26-40
Gender Female, 81.7%
Calm 87.3%
Sad 10.7%
Happy 0.7%
Confused 0.6%
Surprised 0.3%
Angry 0.3%
Fear 0.2%
Disgusted 0%

AWS Rekognition

Age 30-46
Gender Male, 83.9%
Calm 99.2%
Sad 0.4%
Surprised 0.2%
Happy 0.1%
Confused 0.1%
Angry 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 26-40
Gender Male, 93.8%
Calm 85.3%
Surprised 6.5%
Sad 2.8%
Confused 2.6%
Happy 1.4%
Fear 0.7%
Angry 0.5%
Disgusted 0.2%

AWS Rekognition

Age 33-49
Gender Male, 95.5%
Sad 76.7%
Calm 22.3%
Confused 0.6%
Angry 0.1%
Surprised 0.1%
Fear 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 53-71
Gender Male, 79.5%
Calm 99.1%
Happy 0.5%
Surprised 0.2%
Sad 0.2%
Confused 0%
Angry 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 45-63
Gender Male, 67.6%
Happy 90.8%
Calm 7.8%
Sad 0.7%
Surprised 0.3%
Angry 0.2%
Confused 0.1%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 29-45
Gender Male, 91.4%
Calm 71.3%
Sad 9.6%
Happy 8%
Fear 3.7%
Angry 3.1%
Surprised 2.6%
Confused 1.2%
Disgusted 0.4%

AWS Rekognition

Age 31-47
Gender Female, 77.8%
Calm 93.2%
Surprised 4.3%
Happy 1.7%
Sad 0.5%
Angry 0.1%
Confused 0.1%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 22-34
Gender Male, 96.9%
Calm 95.7%
Surprised 2.4%
Angry 1.4%
Sad 0.2%
Happy 0.2%
Confused 0.1%
Fear 0.1%
Disgusted 0%

AWS Rekognition

Age 40-58
Gender Male, 63.3%
Calm 51.8%
Sad 37.5%
Angry 4.3%
Surprised 2.8%
Confused 2.7%
Happy 0.4%
Disgusted 0.4%
Fear 0.2%

AWS Rekognition

Age 45-63
Gender Female, 94.2%
Calm 61.5%
Sad 31.8%
Happy 3.8%
Angry 1.6%
Surprised 0.5%
Confused 0.4%
Fear 0.4%
Disgusted 0.1%

AWS Rekognition

Age 26-40
Gender Female, 82.5%
Calm 96.1%
Surprised 1.5%
Happy 0.7%
Confused 0.6%
Sad 0.5%
Angry 0.4%
Disgusted 0.2%
Fear 0%

AWS Rekognition

Age 17-29
Gender Female, 58.3%
Sad 49.4%
Calm 44.8%
Disgusted 2.6%
Happy 1.9%
Angry 0.5%
Confused 0.3%
Fear 0.3%
Surprised 0.2%

AWS Rekognition

Age 47-65
Gender Male, 69.9%
Calm 67.9%
Sad 21.3%
Happy 10.5%
Confused 0.2%
Angry 0.1%
Surprised 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 36-52
Gender Female, 90%
Calm 94.6%
Happy 3.8%
Surprised 0.7%
Sad 0.5%
Angry 0.2%
Confused 0.1%
Fear 0%
Disgusted 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.8%
Sunglasses 82.4%

Captions

Microsoft

a group of people posing for a photo 81%
a group of people posing for the camera 80.9%
a group of people standing in front of a crowd 80.8%

Text analysis

Amazon

13899
13899.

Google

13899.
13819
13819 13899.