Human Generated Data

Title

Untitled (portrait of little boy standing between two girls)
Date

c. 1950
People

Artist: Paul Gittings, American 1900 - 1988
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.14159

Human Generated Data

Title

Untitled (portrait of little boy standing between two girls)

People

Artist: Paul Gittings, American 1900 - 1988

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-25

Clothing 99.3
Apparel 99.3
Person 99.1
Human 99.1
Person 98.5
Person 98.2
Person 98
Person 97.7
Sleeve 86.1
Coat 85
Overcoat 85
Furniture 84.7
Suit 84.3
Female 82
Long Sleeve 81.7
Dress 77.8
Chair 76.4
Face 75.3
Screen 71.2
Electronics 71.2
Couch 70.3
Person 67
Child 66.7
Kid 66.7
Monitor 65.8
Display 65.8
Flooring 65.7
Woman 65.4
Girl 64.2
Indoors 62.2
Toy 60.7
Doll 60.7
Skin 58.8
Shorts 58.1
Advertisement 57.5
Pants 57.1
Room 56.9
Floor 56.2

Imagga
created on 2022-02-25

man 30.2
adult 30
people 26.8
person 25.9
male 25.8
life 22.6
teacher 21.5
professional 21.2
happy 19.4
indoors 18.4
couple 18.3
women 18.2
smiling 18.1
men 17.2
business 17
businessman 16.8
kin 15.7
holding 15.7
cheerful 15.4
together 14.9
world 14.8
dress 14.5
room 14.3
family 14.2
happiness 14.1
office 13.7
child 13.6
lifestyle 13
two 12.7
clothing 12.5
job 12.4
interior 12.4
smile 12.1
executive 12.1
group 12.1
corporate 12
home 12
portrait 11.6
education 11.3
sitting 11.2
indoor 11
classroom 10.7
mother 10.7
educator 10.6
fashion 10.6
standing 10.4
love 10.3
work 10.2
pretty 9.8
attractive 9.8
working 9.7
businesspeople 9.5
color 9.5
togetherness 9.4
meeting 9.4
communication 9.2
elegance 9.2
worker 9.2
businesswoman 9.1
board 9
window 8.7
bride 8.6
day 8.6
black 8.6
groom 8.4
manager 8.4
coat 8.3
fun 8.2
blackboard 8.1
looking 8
father 8
student 7.8
employee 7.7
friends 7.5
enjoyment 7.5
style 7.4
wedding 7.4
daughter 7.3
building 7.2
team 7.2
modern 7

Google
created on 2022-02-25

Photograph 94.2
Black 89.7
Dress 86.2
Art 84.3
Vintage clothing 76
Toddler 75.6
Snapshot 74.3
Room 73.5
Child 71
Event 69.6
Classic 69.4
Monochrome photography 67.4
Chair 67.3
Stock photography 64.4
Monochrome 64.2
Sitting 62.6
Visual arts 61.1
Baby 61
Retro style 58.2
Photo caption 54.6

Microsoft
created on 2022-02-25

clothing 98.3
child 95.2
baby 95
toddler 92.6
person 89.9
indoor 87.8
human face 85.5
posing 83.6
text 82.7
boy 74.9
woman 73.3
smile 71.1
family 70.2
dress 62

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-8
Gender Female, 99.9%
Happy 99%
Surprised 0.4%
Confused 0.2%
Sad 0.1%
Calm 0.1%
Disgusted 0.1%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 1-7
Gender Female, 100%
Happy 99.9%
Surprised 0%
Sad 0%
Calm 0%
Confused 0%
Fear 0%
Angry 0%
Disgusted 0%

AWS Rekognition

Age 2-8
Gender Female, 100%
Happy 54.4%
Calm 23.2%
Surprised 11.6%
Confused 6.4%
Disgusted 1.7%
Angry 1.1%
Fear 0.9%
Sad 0.7%

AWS Rekognition

Age 1-7
Gender Female, 95.1%
Happy 96.3%
Calm 1%
Confused 0.7%
Disgusted 0.6%
Angry 0.5%
Surprised 0.4%
Sad 0.2%
Fear 0.1%

AWS Rekognition

Age 1-7
Gender Female, 100%
Happy 100%
Surprised 0%
Sad 0%
Angry 0%
Confused 0%
Calm 0%
Disgusted 0%
Fear 0%

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 13
Gender Female

Microsoft Cognitive Services

Age 5
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Unlikely

Feature analysis

Amazon

Person 99.1%
Doll 60.7%

Captions

Microsoft

a group of people posing for a photo 93.6%
a group of people posing for the camera 93.5%
a group of people posing for a picture 93.4%

Text analysis

Amazon

MAQO
D6 12481

Google

MAGO
MAGO