Human Generated Data

Title

Untitled (children dressed up in costumes with parents)

Date

c. 1950

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15557

Human Generated Data

Title

Untitled (children dressed up in costumes with parents)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-19

Clothing 99.9
Apparel 99.9
Human 99.4
Person 99.4
Person 98.4
Person 97.7
Overcoat 96.7
Coat 96.7
Suit 87.7
Tuxedo 83.2
Face 80.3
People 72.3
Art 64.4
Painting 64.4
Portrait 62.7
Photo 62.7
Photography 62.7
Sleeve 59.5
Man 56.2

Imagga
created on 2022-03-19

bow tie 81.7
necktie 64.1
man 39
male 34.7
garment 32.3
people 29.5
person 26.4
adult 25.9
child 25.1
clothing 19.8
love 19.7
happy 19.4
portrait 19.4
face 19.2
couple 19.2
family 18.7
black 16.8
looking 16
happiness 14.9
men 14.6
smiling 14.5
human 14.2
business 13.4
businessman 13.2
suit 12.8
old 12.5
boy 12.2
hand 12.1
smile 12.1
home 12
sitting 11.2
lifestyle 10.8
cheerful 10.6
attractive 10.5
serious 10.5
world 10.4
hair 10.3
expression 10.2
youth 10.2
mother 10.1
car 10.1
holding 9.9
kid 9.7
parent 9.7
one 9.7
tie 9.5
head 9.2
inside 9.2
modern 9.1
fashion 9
indoors 8.8
grandfather 8.8
guy 8.8
cute 8.6
groom 8.6
husband 8.6
father 8.6
office 8.1
dress 8.1
daughter 8
look 7.9
hands 7.8
stress 7.7
wife 7.6
senior 7.5
relationship 7.5
fun 7.5
vehicle 7.5
mature 7.4
wedding 7.4
childhood 7.2
eye 7.1
handsome 7.1
work 7.1
together 7

Google
created on 2022-03-19

Microsoft
created on 2022-03-19

person 99.4
human face 97.5
man 96.1
clothing 94.1
standing 88.9
posing 77.2

Face analysis

Amazon

Google

AWS Rekognition

Age 35-43
Gender Male, 100%
Happy 97.2%
Calm 0.7%
Angry 0.7%
Disgusted 0.5%
Surprised 0.4%
Confused 0.2%
Fear 0.2%
Sad 0.1%

AWS Rekognition

Age 0-6
Gender Male, 94.1%
Calm 99.7%
Surprised 0.1%
Happy 0.1%
Sad 0%
Disgusted 0%
Fear 0%
Angry 0%
Confused 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Suit 87.7%
Painting 64.4%

Captions

Microsoft

a man standing in front of a group of people posing for a photo 90.3%
a man standing in front of a group of people posing for the camera 90.2%
a man and woman posing for a photo 88%