Human Generated Data

Title

Untitled (boy with toy figure collection)
Date

c. 1950, printed later
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.231

Human Generated Data

Title

Untitled (boy with toy figure collection)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.4
Human 99.4
Interior Design 97.2
Indoors 97.2
Room 84.8
Poster 84.1
Advertisement 84.1
Couch 71
Furniture 71
Finger 66.9
Living Room 65.7
Face 64.2
Shelf 56.2
LCD Screen 55.2
Electronics 55.2
Screen 55.2
Monitor 55.2
Display 55.2

Imagga
created on 2022-01-23

blackboard 35.4
cornet 34.2
wind instrument 32
brass 29.1
bass 26.1
man 24.8
musical instrument 21.2
person 20.1
education 18.2
male 17
business 16.4
gun 15.7
adult 14.9
harmonica 14.7
classroom 14.5
hand 14.4
people 13.9
black 13.8
student 13.6
human 13.5
school 13.5
rifle 13.1
board 12.9
class 12.5
weapon 12.3
device 12
free-reed instrument 11.8
businessman 11.5
success 11.3
drawing 11.2
teacher 10.7
chalk 10.7
portrait 10.3
work 10.2
finance 10.1
danger 10
chalkboard 9.8
digital 9.7
technology 9.6
computer 9.6
college 9.5
study 9.3
modern 9.1
suit 9
world 8.9
university 8.6
men 8.6
learn 8.5
firearm 8.5
respirator 8.3
happy 8.1
symbol 8.1
iron lung 7.9
lesson 7.8
teaching 7.8
protect 7.7
expression 7.7
grunge 7.7
writing 7.5
one 7.5
manager 7.4
lady 7.3
room 7.3
lifestyle 7.2
map 7.1
financial 7.1
information 7.1

Google
created on 2022-01-23

Flash photography 85.8
Gesture 85.3
Style 83.9
Black-and-white 83.3
Font 77.6
Blackboard 72.8
Monochrome photography 72.8
Monochrome 71.5
Room 69.7
Suit 68.4
Toddler 66.8
Art 66.6
Stock photography 64.5
Visual arts 64.1
Child 59
Sitting 56.3
Fun 50.7
Pattern 50.7
Automotive design 50.3

Microsoft
created on 2022-01-23

text 99
person 90.4
indoor 85
drawing 78.3
black and white 60.7
picture frame 10.1

Face analysis

Amazon

Google

AWS Rekognition

Age 12-20
Gender Male, 66.7%
Calm 94%
Sad 1.6%
Angry 1.4%
Happy 1.3%
Disgusted 0.6%
Fear 0.6%
Surprised 0.4%
Confused 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Poster 84.1%

Captions

Microsoft

a person standing in front of a mirror posing for the camera 42.6%
a person standing in front of a mirror posing for the camera 42.5%
a person posing for the camera 42.4%