Human Generated Data

Title

Untitled (studio portrait of two brothers sitting side-by-side)
Date

c. 1920 - 1940
People

Artist: O. B. Porter Studio, American active 1930s-1940s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.14169

Human Generated Data

Title

Untitled (studio portrait of two brothers sitting side-by-side)

People

Artist: O. B. Porter Studio, American active 1930s-1940s

Date

c. 1920 - 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Shoe 99.8
Footwear 99.8
Apparel 99.8
Clothing 99.8
Human 99.5
Person 99.5
Shoe 99.3
Person 99
Furniture 93.2
Chair 93.2
Shoe 88.2
Shoe 80.3
Boy 79.5
Accessory 76.6
Accessories 76.6
Tie 76.6
Sailor Suit 76.6
People 70.9
Child 64.7
Kid 64.7
Sitting 60.9
Running Shoe 59.4
Photography 58.1
Portrait 58.1
Photo 58.1
Face 58.1
Jaw 56.9
Shorts 55.2

Clarifai
created on 2019-11-16

people 100
portrait 99.8
child 99.8
two 99.2
wear 97.9
son 97.5
adult 97.5
offspring 97.1
administration 96.7
facial expression 96.1
group 95.8
three 94.9
sibling 94.4
baby 93.2
affection 92.8
monochrome 92.8
actress 92
man 90.7
outfit 90.4
music 90.3

Imagga
created on 2019-11-16

sibling 79.4
child 72.2
family 58.8
father 48.5
male 39.3
mother 39.3
happy 37.6
parent 37.5
kid 34.6
love 34
boy 33.1
smiling 31.9
man 30.9
baby 30.7
people 30.7
childhood 29.6
cute 29.4
children 29.2
happiness 29
fun 28.5
daughter 28
son 27.5
portrait 26.6
dad 26.5
together 26.3
little 25.6
home 25.6
husband 22.9
cheerful 22
couple 20.9
smile 20
sitting 19.8
joy 19.2
playing 19.2
lifestyle 18.8
adult 18.8
casual 18.7
wife 18
kin 17.6
kids 17
laughing 16.1
togetherness 16.1
person 16
holding 15.7
senior 15
face 14.9
brother 14.4
two 14.4
adorable 13.9
mom 13.6
loving 13.4
girls 12.8
black 12.6
toddler 12.4
indoors 12.3
play 12.1
clothing 11.8
parents 11.7
parenthood 11.7
newborn 11.7
boys 11.6
affectionate 11.6
couch 11.6
infant 11.6
30s 11.6
care 11.5
old 11.2
expression 11.1
looking 10.4
men 10.3
grandfather 10.3
youth 10.2
indoor 10.1
offspring 10
leisure 10
studio 9.9
sister 9.8
married 9.6
joyful 9.2
bow tie 9.1
attractive 9.1
outdoors 9
generations 8.9
interior 8.9
blond 8.8
hug 8.7
life 8.7
elderly 8.6
enjoying 8.5
enjoyment 8.5
relationship 8.4
mature 8.4
color 8.4
room 8.3
human 8.3
innocent 7.9
mid adult 7.7
living 7.6
sit 7.6
playful 7.6
relaxed 7.5
three 7.5
hold 7.4
relaxing 7.3
necktie 7.2
domestic 7.2
handsome 7.1
women 7.1

Google
created on 2019-11-16

Photograph 97
People 94.1
Child 91.5
Snapshot 85.6
Standing 81.9
Vintage clothing 77.9
Photography 70.6
Family 63.3
Stock photography 59.4
Black-and-white 56.4
Sibling 55.4
Toddler 55.3

Microsoft
created on 2019-11-16

person 99.9
sitting 99
wall 98.7
clothing 97.4
human face 97.3
child 96.3
toddler 95.5
baby 95.1
smile 95
black 91.7
boy 88.4
text 83.3
posing 63.6
old 47.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-8
Gender Female, 75.3%
Calm 1%
Disgusted 0.1%
Surprised 0.1%
Sad 0.4%
Fear 0.1%
Happy 98.1%
Angry 0.1%
Confused 0.1%

AWS Rekognition

Age 0-3
Gender Male, 65.8%
Angry 0.1%
Happy 57.7%
Disgusted 0%
Surprised 0.1%
Fear 0%
Sad 0.1%
Confused 0.2%
Calm 41.7%

Microsoft Cognitive Services

Age 8
Gender Female

Microsoft Cognitive Services

Age 1
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Shoe 99.8%
Person 99.5%
Tie 76.6%

Captions

Microsoft

a group of people sitting posing for the camera 96.7%
a group of people sitting posing for a photo 95.3%
a group of people posing for a photo 95.1%