Human Generated Data

Title

Untitled (couple dancing)

Date

c. 1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4943

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (couple dancing)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Apparel 98.7
Clothing 98.7
Human 98.1
Person 98.1
Person 98
Person 94.1
Person 91.8
Suit 88.2
Coat 88.2
Overcoat 88.2
Person 85.1
Female 75.1
Leisure Activities 74.2
Dress 73.5
Accessories 70.1
Accessory 70.1
Tie 70.1
People 67
Robe 66.7
Fashion 66.7
Gown 66.7
Person 63.8
Evening Dress 63.4
Crowd 60.4
Shirt 60.2
Dance Pose 60
Woman 60
Wedding 59.5
Tuxedo 59.3
Face 57.1
Finger 57.1
Hug 55.5
Dating 55.1

Imagga
created on 2022-01-23

man 43
business 37.6
male 35.4
person 35.4
businessman 35.3
people 32.9
office 30.6
job 29.2
work 28.5
adult 27.4
professional 26.8
computer 26.5
laptop 22
businesspeople 21.8
corporate 21.5
portrait 20
looking 20
men 19.7
handsome 19.6
indoor 19.2
executive 18.3
senior 17.8
mature 17.6
face 17
career 17
manager 16.7
occupation 15.6
modern 15.4
success 15.3
happy 15
worker 14.5
indoors 14
glasses 13.9
employee 13.4
desk 13.4
formal 13.4
working 13.2
doctor 13.1
color 12.8
team 12.5
wagon 12.5
lifestyle 12.3
education 12.1
notebook 11.6
corporation 11.6
1 11.6
smiling 11.6
medical 11.5
smile 11.4
group 11.3
old 11.1
health 11.1
casual 11
day 11
successful 11
alone 10.9
confident 10.9
businesswoman 10.9
medicine 10.6
only 10.5
serious 10.5
clothing 10.5
hospital 10.3
room 10
suit 9.8
mid adult 9.6
uniform 9.6
busy 9.6
leadership 9.6
confidence 9.6
wheeled vehicle 9.4
company 9.3
communication 9.2
positive 9.2
jacket 9
technology 8.9
gray hair 8.9
table 8.8
building 8.7
couple 8.7
profession 8.6
sitting 8.6
tie 8.5
one person 8.5
shirt 8.4
student 8.4
attractive 8.4
drawing 8.3
cheerful 8.1
stethoscope 7.9
women 7.9
together 7.9
businessmen 7.8
businessperson 7.8
colleagues 7.8
employment 7.7
clinic 7.7
exam 7.7
elderly 7.6
studio 7.6
hand 7.6
pen 7.5
horizontal 7.5
meeting 7.5
teamwork 7.4
care 7.4
inside 7.4

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

person 98.3
clothing 94.2
text 92
human face 85.3
woman 81.3
standing 80.1
smile 78.2
man 76.7
sketch 54.5
posing 51.5

Face analysis

Amazon

Google

AWS Rekognition

Age 52-60
Gender Female, 95.4%
Calm 93.7%
Happy 2.2%
Surprised 1.4%
Confused 0.8%
Fear 0.7%
Disgusted 0.6%
Sad 0.3%
Angry 0.2%

AWS Rekognition

Age 39-47
Gender Female, 93.5%
Calm 94.7%
Happy 3.3%
Disgusted 0.5%
Sad 0.4%
Surprised 0.4%
Confused 0.3%
Fear 0.3%
Angry 0.2%

AWS Rekognition

Age 49-57
Gender Male, 72.9%
Calm 60.3%
Confused 12.1%
Happy 9.5%
Disgusted 7.1%
Sad 5.4%
Surprised 2.9%
Angry 1.6%
Fear 1.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Feature analysis

Amazon

Person 98.1%
Tie 70.1%

Captions

Microsoft

a group of people posing for a photo 95.6%
a group of people posing for the camera 95.5%
a group of people posing for a picture 95.4%

Text analysis

Amazon

12657
12657.

Google

12657.
12657.