Human Generated Data

Title

Untitled (boys playing with blocks, placing blocks on heads)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16332

Human Generated Data

Title

Untitled (boys playing with blocks, placing blocks on heads)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-11

Human 99.2
Person 99.2
Person 98.3
Home Decor 97.2
Play 93
Chair 90.2
Furniture 90.2
Apparel 84.3
Clothing 84.3
Food 82.3
Meal 82.3
Kid 79.6
Child 79.6
Boy 79
Face 76.7
Window 76
Shorts 73.6
Dish 70
Plant 69.6
Floor 68.4
Indoors 64.1
Table 63.5
Door 61.1
Photography 60.7
Photo 60.7
Baby 59.5
Grass 59.3
Building 58.7
Housing 58.7
Dining Table 58.2
Screen 57.8
Electronics 57.8
Female 56
Tree 55.7
Flooring 55.7
Display 55.1
Monitor 55.1

Imagga
created on 2022-02-11

man 28.2
adult 25.2
people 24.5
male 24.3
person 22
lifestyle 18.8
business 17.6
attractive 17.5
room 16.9
happy 16.9
businessman 16.8
office 15.6
bathroom 15.3
pretty 14.7
corporate 14.6
handsome 14.3
portrait 14.2
clothing 14
building 13.6
suit 13.1
body 12.8
casual 12.7
work 12.6
city 12.5
smiling 12.3
professional 12.3
smile 12.1
black 12
men 12
home 12
modern 11.9
indoor 11.9
women 11.9
health 11.8
interior 11.5
bath 11.4
vessel 11.3
tub 11.3
worker 11.2
looking 11.2
successful 11
happiness 11
fashion 10.5
executive 10.5
sexy 10.4
standing 10.4
expression 10.2
relaxation 10
house 10
cheerful 9.7
job 9.7
indoors 9.7
couple 9.6
window 9.6
hair 9.5
healthy 9.4
water 9.3
cute 9.3
girls 9.1
holding 9.1
dress 9
human 9
spa 9
wet 8.9
success 8.8
computer 8.8
urban 8.7
brunette 8.7
education 8.7
sitting 8.6
skin 8.5
company 8.4
care 8.2
one 8.2
confident 8.2
world 8.1
group 8.1
posing 8
working 7.9
gym 7.6
career 7.6
communication 7.6
clean 7.5
leisure 7.5
laptop 7.4
back 7.3
alone 7.3
exercise 7.3
kitchen 7.3
active 7.2
blond 7.2
childhood 7.2
face 7.1

Google
created on 2022-02-11

White 92.2
Black 89.7
Black-and-white 85.6
Style 84.1
Window 82.9
Audio equipment 78.1
Hat 77.8
Monochrome photography 76.5
Monochrome 75.9
Room 69.2
Eyewear 67
Table 63.9
Stock photography 61.7
Sitting 61.1
Still life photography 58.4
Flooring 55.9
T-shirt 53.7
Selfie 52.4
Photography 52
Display device 51.8

Microsoft
created on 2022-02-11

text 98.6
window 98.5
clothing 95.4
person 94.7
black and white 75.8
waste container 50.8

Face analysis

Amazon

Google

AWS Rekognition

Age 6-14
Gender Female, 84.1%
Surprised 61%
Happy 26%
Fear 6.4%
Calm 2.8%
Angry 2.4%
Disgusted 0.7%
Sad 0.4%
Confused 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%

Captions

Microsoft

a group of people standing in front of a window 76.3%
a group of people in front of a window 76%
a group of people sitting in front of a window 64.8%

Text analysis

Amazon

R
55
E
T
0
-

Google

55
55