Human Generated Data

Title

Untitled (two formally dressed couples seated at a table)

Date

c. 1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5635

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (two formally dressed couples seated at a table)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Person 99.8
Human 99.8
Clothing 99.2
Apparel 99.2
Person 99.2
Person 98.4
Person 98
Person 97.9
Person 97.7
Person 94.9
Person 93.5
Person 92.4
Person 88
Robe 84.7
Fashion 84.7
Gown 83.9
Suit 81.3
Overcoat 81.3
Coat 81.3
Wedding 78.2
Person 77
Person 71.2
Wedding Gown 69.3
Shirt 68.4
Photography 67
Photo 67
Crowd 65.2
Female 64.4
Face 64
People 63.4
Person 62.8
Photographer 59.4
Tuxedo 58.5
Portrait 58.4
Bride 57.3
Bridegroom 55.2

Imagga
created on 2021-12-15

nurse 64.6
person 51
patient 47.2
man 39.6
people 34.6
male 33.3
case 31.4
sick person 30
adult 26.8
businessman 23.8
business 21.9
team 20.6
teacher 20.6
happy 20
group 19.3
education 19
senior 18.7
professional 18
student 18
meeting 17.9
home 17.5
men 17.2
casual 16.9
indoors 16.7
couple 16.5
sitting 16.3
smiling 15.9
colleagues 15.5
indoor 15.5
office 15.3
together 14.9
mature 14.9
classroom 14.8
room 14.7
specialist 14.7
life 14.5
businesswoman 14.5
class 14.5
businesspeople 14.2
desk 14.2
teamwork 13.9
table 13.8
school 13.6
medical 13.2
child 13
30s 12.5
holding 12.4
working 12.4
lifestyle 12.3
looking 12
coworkers 11.8
happiness 11.7
40s 11.7
worker 11.6
job 11.5
elderly 11.5
health 11.1
camera 11.1
blackboard 10.9
board 10.8
hospital 10.8
coat 10.7
interior 10.6
cheerful 10.6
husband 10.5
portrait 10.3
doctor 10.3
women 10.3
work 10.2
hand 9.9
to 9.7
two people 9.7
retirement 9.6
smile 9.3
20s 9.2
lab coat 9
associates 8.8
discussion 8.8
retired 8.7
four 8.6
talking 8.5
wife 8.5
two 8.5
clothing 8.4
old 8.4
suit 8.1
handsome 8
family 8
love 7.9
crew 7.9
clinic 7.8
boy 7.8
standing 7.8
60s 7.8
half length 7.8
color 7.8
corporate 7.7
cooperation 7.7
mid adult 7.7
busy 7.7
attractive 7.7
exam 7.7
illness 7.6
college 7.6
females 7.6
executive 7.4
day 7.1
medicine 7

Google
created on 2021-12-15

Shirt 94.1
Black 89.6
Hat 89.4
Black-and-white 85.2
Style 83.9
Table 80.2
Font 76.2
Monochrome photography 74.8
T-shirt 74.5
Event 74.1
Monochrome 72.2
Vintage clothing 72.2
Cooking 68.2
Room 68.1
Art 66
Team 65.8
Motor vehicle 65.7
Stock photography 64.9
Recreation 64.2
Photo caption 63.9

Microsoft
created on 2021-12-15

person 99.6
text 97.4
clothing 96.4
posing 91.5
outdoor 89.1
man 85.6
woman 74.7
military vehicle 65.7
group 60.7
old 49

Face analysis

Amazon

Google

AWS Rekognition

Age 39-57
Gender Male, 96%
Calm 85.6%
Sad 5.4%
Happy 4.4%
Angry 2.1%
Fear 1.2%
Surprised 0.9%
Disgusted 0.3%
Confused 0.2%

AWS Rekognition

Age 29-45
Gender Female, 63.5%
Surprised 95.5%
Calm 2.4%
Angry 1.3%
Confused 0.4%
Fear 0.2%
Sad 0.1%
Happy 0.1%
Disgusted 0%

AWS Rekognition

Age 23-35
Gender Female, 84.8%
Calm 86.4%
Sad 11.6%
Happy 0.9%
Angry 0.5%
Surprised 0.3%
Fear 0.1%
Confused 0.1%
Disgusted 0%

AWS Rekognition

Age 19-31
Gender Female, 71.8%
Calm 83.7%
Surprised 6.3%
Happy 3.5%
Confused 2.4%
Sad 1.9%
Angry 1.2%
Fear 0.6%
Disgusted 0.4%

AWS Rekognition

Age 22-34
Gender Female, 52.8%
Calm 91.5%
Sad 2.3%
Confused 2.2%
Angry 1.8%
Surprised 1.6%
Fear 0.3%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 43-61
Gender Male, 98.5%
Calm 60.5%
Happy 31.3%
Angry 3.2%
Surprised 2.2%
Confused 1.3%
Sad 0.8%
Fear 0.5%
Disgusted 0.2%

AWS Rekognition

Age 28-44
Gender Female, 52%
Calm 67.5%
Sad 21.8%
Confused 4.2%
Fear 2.8%
Surprised 1.9%
Angry 1%
Happy 0.8%
Disgusted 0.1%

AWS Rekognition

Age 33-49
Gender Male, 93.9%
Surprised 34.5%
Calm 24.6%
Confused 13%
Disgusted 10.5%
Sad 6%
Angry 3.8%
Fear 3.8%
Happy 3.7%

AWS Rekognition

Age 45-63
Gender Male, 75.4%
Calm 61.5%
Happy 26.7%
Angry 4%
Sad 4%
Confused 1.6%
Surprised 1.4%
Disgusted 0.5%
Fear 0.2%

AWS Rekognition

Age 27-43
Gender Female, 84.1%
Sad 34.3%
Disgusted 14.3%
Angry 13.7%
Fear 13.6%
Happy 12.6%
Calm 5.8%
Confused 3%
Surprised 2.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%

Captions

Microsoft

a group of people posing for a photo 94.7%
a group of people posing for the camera 94.6%
a group of people posing for a picture 94.5%

Text analysis

Amazon

10
13940.
TOTA
صحة
صحة and
and

Google

.
10
139니0. 13940. 10
139
0
13940.