Human Generated Data

Title

Untitled (group of children, boy opening presents)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17638

Human Generated Data

Title

Untitled (group of children, boy opening presents)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17638

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Clothing 99.5
Apparel 99.5
Person 99.1
Human 99.1
Person 98.8
Couch 91.6
Furniture 91.6
Person 86.7
Hat 81.3
Person 79.8
Cushion 72.3
Sun Hat 66
Face 62.9
Female 60.6
Girl 56.4

Clarifai
created on 2023-10-28

people 99.9
group 98.7
adult 97.4
man 97.2
child 96.3
woman 94.1
administration 93.4
leader 91.6
music 90.3
three 90
furniture 89.9
two 89.5
room 86.5
wear 85.8
boy 85.8
art 85.5
group together 84.8
war 84.1
chair 83.6
retro 83.5

Imagga
created on 2022-02-26

newspaper 46.9
product 34.8
senior 30.9
people 30.7
man 28.9
creation 27.1
home 23.9
person 23.4
male 23.4
happy 21.3
smiling 19.5
old 19.5
laptop 19.4
portrait 19.4
retired 19.4
elderly 18.2
adult 17.7
mature 17.7
couple 17.4
retirement 16.3
sitting 15.5
husband 15.3
indoors 14.9
wife 14.2
business 14
computer 13.9
smile 13.5
family 12.5
lifestyle 12.3
together 12.3
looking 12
money 11.9
hair 11.1
currency 10.8
relaxed 10.3
women 10.3
gray 9.9
office 9.7
technology 9.6
black 9.6
blond 9.4
glasses 9.3
cash 9.2
relaxing 9.1
room 8.9
grandmother 8.8
love 8.7
education 8.7
happiness 8.6
sofa 8.6
modern 8.4
student 8.4
communication 8.4
holding 8.3
human 8.2
businesswoman 8.2
device 8.2
job 8
work 7.9
face 7.8
table 7.8
using 7.7
pretty 7.7
attractive 7.7
bill 7.6
reading 7.6
finance 7.6
professional 7.6
banking 7.4
investment 7.3
cheerful 7.3
grandfather 7.3
paper 7.3
financial 7.1
worker 7.1
working 7.1

Google
created on 2022-02-26

Hat 84.1
Art 81.7
Vintage clothing 71
Monochrome photography 70.5
Event 70.4
Room 69.1
Monochrome 68.8
Painting 68.7
Visual arts 68.5
Fun 62
Pattern 60.1
Photographic paper 59.4
Illustration 58.3
Font 56.8
History 55.1
Drawing 53.1
Printmaking 51.9

Microsoft
created on 2022-02-26

text 96.3
drawing 91.9
person 91.4
clothing 91.4
indoor 91.2
human face 79.5
black and white 76.2
sketch 57.2

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 16-22
Gender Male, 96.4%
Calm 49.6%
Sad 42.2%
Angry 2.1%
Confused 1.6%
Fear 1.4%
Surprised 1.3%
Disgusted 1%
Happy 0.8%

AWS Rekognition

Age 21-29
Gender Male, 65.8%
Calm 44%
Sad 14.3%
Happy 12.9%
Disgusted 11.6%
Fear 8.3%
Angry 5%
Confused 2.2%
Surprised 1.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 99.1%
Person 98.8%
Person 86.7%
Person 79.8%

Captions

Microsoft
created on 2022-02-26

a group of people sitting on a bed 59.5%
a girl sitting on a bed 53.8%