Human Generated Data

Title

Untitled (men shaking hands by car)

Date

c. 1950

People

Artist: Bachrach Studios, founded 1868

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18998

Human Generated Data

Title

Untitled (men shaking hands by car)

People

Artist: Bachrach Studios, founded 1868

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Apparel 99.7
Clothing 99.7
Person 98.2
Human 98.2
Person 95.8
Person 91.6
Sleeve 90
Face 86.1
Female 79.2
Long Sleeve 78.8
Accessories 78.5
Sunglasses 78.5
Accessory 78.5
Overcoat 70.3
Coat 70.3
Fashion 65.7
Robe 65.7
People 65.1
Woman 64.7
Finger 63.7
Suit 63.5
Gown 62.4
Portrait 62.3
Photography 62.3
Photo 62.3
Shirt 59.7
Bridegroom 57.7
Wedding 57.7
Dating 57.5
Hat 55.4

Imagga
created on 2022-03-05

bow tie 52.8
necktie 47.2
man 45.7
male 39
person 36.7
people 32.4
adult 30.5
business 29.8
groom 28.8
businessman 27.4
professional 25.5
garment 22.9
happy 21.9
office 21.8
suit 21.6
portrait 21.4
smile 20.7
looking 20
face 19.9
work 19
men 18.9
clothing 17.6
smiling 17.4
corporate 17.2
worker 16.5
building 16
working 15.9
mature 15.8
handsome 15.2
phone 14.8
confident 14.6
musical instrument 14
lifestyle 13.7
businesspeople 13.3
job 13.3
manager 13
serious 12.4
tie 12.3
couple 12.2
executive 11.9
occupation 11.9
modern 11.9
attractive 11.9
casual 11.9
day 11.8
coat 11.5
mobile 11.3
employee 11.3
outdoors 11.2
love 11
wind instrument 11
communication 10.9
holding 10.7
medical 10.6
success 10.5
expression 10.2
car 10.2
student 10.2
hand 9.9
talking 9.5
meeting 9.4
happiness 9.4
doctor 9.4
senior 9.4
successful 9.2
businesswoman 9.1
one 9
computer 8.8
indoors 8.8
middle aged 8.8
lab 8.7
urban 8.7
exam 8.6
profession 8.6
sitting 8.6
telephone 8.5
smart 8.5
pretty 8.4
glasses 8.3
laptop 8.2
laboratory 7.7
outside 7.7
automobile 7.7
illness 7.6
hospital 7.5
joy 7.5
city 7.5
light 7.4
alone 7.3
women 7.1
together 7
look 7

Microsoft
created on 2022-03-05

text 96.9
person 89.6
clothing 89.1
black and white 87.5
man 86.7
human face 69.2

Face analysis

Amazon

Google

AWS Rekognition

Age 47-53
Gender Female, 61.2%
Sad 48.8%
Happy 21.5%
Calm 19.9%
Surprised 3.2%
Disgusted 2.3%
Angry 2%
Fear 1.2%
Confused 1.2%

AWS Rekognition

Age 26-36
Gender Male, 77.6%
Calm 84.7%
Sad 14.5%
Happy 0.3%
Confused 0.2%
Angry 0.1%
Fear 0.1%
Disgusted 0.1%
Surprised 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.2%
Sunglasses 78.5%
Suit 63.5%

Captions

Microsoft

a man looking at the camera 59.5%
a man and a woman looking at the camera 29.1%
a group of people looking at a computer 29%

Text analysis

Amazon

SAFET
5
KODAK
3
4
9
و

Google

KÓDAK
SAFET
3.
3. KÓDAK SAFET