Human Generated Data

Title

Untitled (young boy and girl seated, playing with boxes)
Date

c. 1940
People

Artist: O. B. Porter Studio, American active 1930s-1940s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1333

Human Generated Data

Title

Untitled (young boy and girl seated, playing with boxes)

People

Artist: O. B. Porter Studio, American active 1930s-1940s

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.6
Human 99.6
Person 98.9
Clothing 97.8
Apparel 97.8
Furniture 92.4
Chair 92.4
Shoe 77.6
Footwear 77.6
Shoe 76.4
Shoe 73.8
Kid 62.4
Child 62.4
People 60.7
Face 60.5
Female 59.3
Girl 59.3
Indoors 58.2
Floor 58
Hat 56.5

Imagga
created on 2022-01-23

child 72.7
family 43.6
happy 38.3
parent 35.5
mother 35
daughter 34.9
childhood 34.1
people 32.9
kid 32.8
happiness 32.1
love 30.8
brother 30.4
cute 28.7
smile 27.8
fun 27
sibling 25.8
little 25.6
portrait 25.3
cheerful 24.4
smiling 23.9
boy 23.5
person 23.1
together 22.8
joy 22.6
face 22
children 21.9
son 21.5
baby 21.1
girls 21
toddler 19.1
male 18.6
lifestyle 18.1
two 17.8
innocent 17.6
home 17.6
adult 17.5
playing 17.3
father 17.3
casual 17
man 16.8
youth 16.2
kids 16
adorable 15.7
leisure 15
outdoors 14.9
couple 14.8
laughing 14.2
park 14
play 13.8
eyes 13.8
outside 13.7
women 13.5
life 13.4
dad 13.2
togetherness 13.2
summer 12.9
mom 12.6
attractive 12.6
joyful 12
pretty 11.9
hair 11.9
infant 11.6
healthy 11.3
human 11.3
looking 11.2
juvenile 11.1
holding 10.7
care 10.7
laugh 10.5
indoors 10.5
husband 10.5
loving 10.5
clothing 10.5
enjoy 10.4
sitting 10.3
sweet 10.3
grass 10.3
expression 10.2
kin 10.2
grandmother 9.8
old 9.8
black 9.6
blond 9.6
enjoying 9.5
one 9
parenting 8.8
parenthood 8.8
motherhood 8.8
boys 8.7
generation 8.6
day 8.6
playful 8.5
enjoyment 8.5
relationship 8.4
mature 8.4
lovely 8
offspring 8
parents 7.8
sister 7.8
color 7.8
newborn 7.8
preschool 7.8
affectionate 7.7
wife 7.6
dark 7.5
senior 7.5
emotion 7.4
natural 7.4
funny 7.3
group 7.3

Google
created on 2022-01-23

Flash photography 87.4
Gesture 85.3
Baby 81.8
Tints and shades 77.3
Toddler 77.3
Happy 75.8
Vintage clothing 73.4
Monochrome photography 73.4
Grass 73.1
Monochrome 72.3
Child 70.1
Photo caption 67.9
Sitting 66.8
Fun 65.9
Stock photography 63.1
Boot 62.5
Room 62.2
Flooring 60.7
Photographic paper 57.6
Chair 56

Microsoft
created on 2022-01-23

person 98.8
clothing 98.5
human face 97.7
toddler 93.3
baby 90.3
smile 85
footwear 65.5
text 64.6
boy 61.5

Face analysis

Amazon

Google

AWS Rekognition

Age 0-6
Gender Female, 93.4%
Sad 68%
Disgusted 30.3%
Angry 0.6%
Fear 0.5%
Calm 0.3%
Confused 0.1%
Surprised 0.1%
Happy 0.1%

AWS Rekognition

Age 4-12
Gender Female, 60.7%
Calm 86.1%
Surprised 12.5%
Confused 0.5%
Happy 0.2%
Angry 0.2%
Sad 0.2%
Disgusted 0.2%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Shoe 77.6%

Captions

Microsoft

a group of baseball players standing on top of a building 35.9%
a group of baseball players standing on top of a suitcase 25.4%

Text analysis

Amazon

FOATER

Google

FORTEX
FORTEX