Human Generated Data

Title

Untitled (five children)

Date

c. 1960

People

Artist: Bachrach Studios, founded 1868

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.774

Human Generated Data

Title

Untitled (five children)

People

Artist: Bachrach Studios, founded 1868

Date

c. 1960

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.6
Human 99.6
Person 99.4
Person 98.1
Face 98.1
Person 95.4
Person 90.4
Baby 86.6
People 84.1
Smile 82.3
Newborn 77.2
Photography 68.2
Photo 68.2
Portrait 66
Poster 62.1
Advertisement 62.1
Person 61.8
Tree 60.6
Plant 60.6
Female 60.4
Collage 58.4
Family 56.7
Laughing 56.6

Imagga
created on 2022-01-23

kin 72.1
man 42.3
home 38.3
people 37.9
male 36.3
senior 34.7
couple 32.2
happy 32
family 30.2
elderly 29.7
person 29.2
mature 28.8
smiling 27.5
adult 27.4
together 27.2
computer 25.7
indoors 25.5
laptop 22.9
old 22.3
portrait 22
lifestyle 21.7
sitting 21.5
happiness 21.2
grandfather 21
mother 20.7
parent 20.2
child 19.7
retired 19.4
retirement 19.2
casual 18.6
husband 18.1
fun 16.5
grandma 16.4
older 15.5
working 15
love 15
smile 15
technology 14.8
cheerful 14.6
office 14.6
day 14.1
men 13.7
father 13.7
looking 13.6
two 13.6
wife 13.3
relaxed 13.1
indoor 12.8
business 12.8
aged 12.7
horizontal 12.6
room 12.5
camera 12
70s 11.8
60s 11.7
leisure 11.6
desk 11.5
enjoying 11.4
pensioner 11.3
daughter 11.3
color 11.1
women 11.1
dad 11
casual clothing 10.8
kid 10.6
couch 10.6
modern 10.5
age 10.5
education 10.4
togetherness 10.4
work 10.2
playing 10
house 10
face 9.9
grandmother 9.8
teaching 9.7
little 9.7
group 9.7
married 9.6
sofa 9.6
friends 9.4
clothing 9.3
relaxing 9.1
seniors 8.8
good mood 8.8
living room 8.8
table 8.7
boy 8.7
using 8.7
classroom 8.6
laughing 8.5
learning 8.5
enjoyment 8.4
relationship 8.4
joy 8.4
blond 8.3
children 8.2
professional 8
handsome 8
sibling 8
to 8
businessman 7.9
grandchild 7.9
gray hair 7.9
browsing 7.9
half length 7.8
two people 7.8
talking 7.6
communication 7.6
kids 7.5
friendship 7.5
holding 7.4
lady 7.3
cute 7.2
worker 7.2
bright 7.1

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

window 99.4
clothing 98.6
baby 98.6
human face 98.1
gallery 97.4
smile 96.7
toddler 93.2
room 91.9
person 85.7
scene 85.5
man 75.1
boy 68.1
text 63.2
posing 59
old 56.7
picture frame 22.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-16
Gender Male, 94.8%
Calm 96.6%
Confused 1.3%
Happy 0.6%
Sad 0.4%
Angry 0.4%
Disgusted 0.3%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 6-16
Gender Female, 100%
Happy 99.6%
Confused 0.1%
Surprised 0.1%
Calm 0.1%
Angry 0%
Disgusted 0%
Sad 0%
Fear 0%

AWS Rekognition

Age 6-14
Gender Male, 100%
Happy 48.5%
Confused 29.6%
Calm 10.3%
Disgusted 4.2%
Sad 3.8%
Angry 1.8%
Surprised 1%
Fear 0.7%

AWS Rekognition

Age 6-14
Gender Female, 83.8%
Happy 99.8%
Angry 0.1%
Surprised 0%
Confused 0%
Disgusted 0%
Fear 0%
Sad 0%
Calm 0%

AWS Rekognition

Age 0-3
Gender Female, 99.9%
Happy 78.9%
Sad 12.7%
Calm 2.3%
Disgusted 2.1%
Fear 1.2%
Angry 1.2%
Confused 0.9%
Surprised 0.6%

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 7
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 8
Gender Male

Microsoft Cognitive Services

Age 0
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Captions

Microsoft

a group of people posing for a photo in front of a window 89.1%
a group of people sitting in front of a window 85.5%
a group of people sitting in front of a window posing for the camera 81.2%

Text analysis

Amazon

Boodfied

Google

Badd
B
Badd B