Human Generated Data

Title

Untitled (men in suits at a reception)
Date

c. 1950
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10489
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (men in suits at a reception)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 99.5
Human 99.5
Clothing 99.2
Apparel 99.2
Person 98.5
Person 98.3
Person 97.9
Person 97.4
Person 97.2
Person 96.5
Person 95.8
Person 93.6
Person 91
Person 88.9
Coat 87.5
Suit 85.8
Overcoat 85.8
Person 79.9
Lab Coat 77.1
Shirt 71.7
Shoe 67.8
Footwear 67.8
People 63.2
Shoe 61.7
Indoors 60.2
Tuxedo 58.7
Crowd 57.5
Sailor Suit 56.6
Flooring 56.4
Clinic 55.8

Imagga
created on 2022-01-09

people 37.3
man 34.9
male 29
businessman 28.2
business 27.3
person 22.1
group 21.7
adult 20.5
businesswoman 18.2
women 17.4
men 17.2
team 16.1
job 15
musical instrument 14.9
couple 14.8
corporate 14.6
mature 13.9
office 13.8
happy 13.8
work 13.6
modern 13.3
walking 13.2
teamwork 13
portrait 12.9
lifestyle 12.3
success 12.1
human 12
percussion instrument 11.6
together 11.4
life 11.3
travel 11.3
old 11.1
casual 11
two 11
professional 11
groom 10.9
building 10.7
crowd 10.5
meeting 10.4
suit 10.3
company 10.2
brass 10.1
worker 10
silhouette 9.9
nurse 9.9
colleagues 9.7
boss 9.6
standing 9.5
businesspeople 9.5
room 9.5
manager 9.3
marimba 9.2
20s 9.1
city 9.1
clothing 9
love 8.7
day 8.6
uniform 8.6
walk 8.6
adults 8.5
hand 8.3
occupation 8.2
night 8
smiling 7.9
executive 7.9
indoors 7.9
wind instrument 7.9
holiday 7.9
happiness 7.8
black 7.8
trombone 7.8
architecture 7.8
four 7.7
talking 7.6
friends 7.5
senior 7.5
vacation 7.4
successful 7.3
new 7.3
tourist 7.2
looking 7.2
working 7.1

Google
created on 2022-01-09

Black 89.5
Black-and-white 85.9
Gesture 85.3
Style 83.8
Adaptation 79.5
Suit 74.8
Monochrome 74.7
Formal wear 74.5
Monochrome photography 74.2
Event 72.9
Vintage clothing 70.9
Room 70.6
Art 69.5
Uniform 65.3
Font 63.3
Photo caption 62.7
Photographic paper 61.9
Stock photography 61.7
History 60.9
Team 55.9

Microsoft
created on 2022-01-09

person 99.8
text 97.8
clothing 96.1
standing 93.8
woman 85.4
man 84.4
wedding dress 83.2
group 77.8
dress 70.7
bride 67.9
people 56.8
line 42.4

Face analysis

Amazon

Google

AWS Rekognition

Age 45-51
Gender Male, 99.9%
Sad 51.4%
Calm 24.1%
Confused 10.9%
Angry 7%
Happy 4.5%
Disgusted 1.3%
Surprised 0.5%
Fear 0.3%

AWS Rekognition

Age 34-42
Gender Female, 84.6%
Calm 90.5%
Happy 5.1%
Sad 3.7%
Disgusted 0.2%
Angry 0.2%
Confused 0.1%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 23-33
Gender Male, 98.7%
Calm 92%
Happy 3.6%
Sad 3.3%
Fear 0.5%
Surprised 0.2%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Shoe 67.8%

Captions

Microsoft

a group of people standing next to a line 97.3%
a group of people standing in a line 97%
a group of people posing for the camera 96.8%

Text analysis

Google

2-- XAGO X
2--
XAGO
X