Human Generated Data

Title

Untitled (father with three sons)

Date

c. 1950

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6905

Human Generated Data

Title

Untitled (father with three sons)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 99.6
Person 99.6
Person 99.4
Person 98.7
Person 98.2
People 97.5
Family 96.9
Face 96.8
Smile 88.2
Baby 82.8
Boy 80.7
Photo 72.1
Photography 72.1
Clothing 69.7
Apparel 69.7
Portrait 69.3
Kid 67.8
Child 67.8
Newborn 55.5

Imagga
created on 2022-01-23

child 89
family 67.7
sibling 67.1
kin 64
father 56.5
mother 50.8
parent 44.5
son 43.6
happy 42.7
children 41.1
love 40.3
boy 38.3
kid 38.2
male 38
together 36.9
baby 33.5
dad 33
daughter 32.9
happiness 32.2
smiling 30.4
portrait 29.2
cute 28
people 27.9
childhood 26.9
kids 26.4
little 25.7
smile 25
man 24.9
joy 22.6
fun 21.8
home 21.6
mom 21.4
brother 19.4
adult 18.8
cheerful 18.7
group 18.6
lifestyle 18.1
togetherness 18
casual 17.8
husband 17.2
two 17
adorable 16.6
parents 16.6
couple 16.6
holding 16.5
hug 16.5
girls 16.4
infant 16.4
toddler 16.3
care 15.7
boys 15.5
youth 15.4
affectionate 14.5
hugging 13.7
30s 13.5
generation 13.5
loving 13.4
generations 12.9
playing 12.8
four 12.5
wife 12.4
senior 12.2
face 12.1
grandchild 11.9
grandfather 11.7
newborn 11.7
person 11.7
leisure 11.6
diversity 11.6
indoors 11.4
outdoors 11.2
men 11.2
sitting 11.2
sister 10.8
parenthood 10.8
embracing 10.8
offspring 10.8
attractive 10.5
women 10.3
black 10.2
hold 10.2
indoor 10.1
granddaughter 9.9
mommy 9.9
cuddle 9.9
clothing 9.9
mid adult 9.7
looking camera 9.6
ethnic 9.5
laughing 9.5
mature 9.3
looking 8.8
sweet 8.7
race 8.6
life 8.6
enjoying 8.5
color 8.4
park 8.3
fatherhood 7.9
daddy 7.9
brothers 7.9
siblings 7.9
mum 7.8
bonding 7.8
education 7.8
thirties 7.8
old 7.7
studio 7.6
horizontal 7.6
friendship 7.5
joyful 7.4
school 7.3

Google
created on 2022-01-23

Face 98.3
Smile 97.7
Shirt 94.3
Flash photography 87.9
Iris 85.5
Happy 84.5
Style 83.8
Collar 82.8
Picture frame 81
Toddler 78.9
Vintage clothing 77.5
Art 72.5
Event 72.4
Baby 72.2
Fun 72.2
Monochrome photography 70.5
Monochrome 68.6
Family taking photos together 67.7
Classic 67.1
Child 66.4

Microsoft
created on 2022-01-23

person 99.9
baby 98.9
human face 98.7
toddler 98.6
boy 96.4
smile 95.2
clothing 94.3
window 93.4
child 92.9
indoor 90.4
posing 82.2
text 69.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-43
Gender Male, 100%
Happy 95.9%
Angry 3.6%
Confused 0.3%
Surprised 0.1%
Disgusted 0.1%
Fear 0%
Sad 0%
Calm 0%

AWS Rekognition

Age 0-4
Gender Female, 97.8%
Calm 90.2%
Surprised 5.3%
Confused 1.5%
Disgusted 1%
Happy 0.8%
Sad 0.5%
Angry 0.5%
Fear 0.2%

AWS Rekognition

Age 2-8
Gender Female, 98.6%
Happy 98.5%
Surprised 0.5%
Calm 0.3%
Confused 0.2%
Fear 0.2%
Sad 0.1%
Angry 0.1%
Disgusted 0.1%

AWS Rekognition

Age 13-21
Gender Male, 100%
Happy 77.1%
Calm 15.4%
Confused 3%
Angry 1.9%
Sad 0.9%
Surprised 0.7%
Disgusted 0.6%
Fear 0.3%

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 10
Gender Male

Microsoft Cognitive Services

Age 1
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Captions

Microsoft

a group of people posing for a photo 96%
a group of people posing for the camera 95.9%
a group of kids posing for a photo 89.6%