Human Generated Data

Title

Untitled (man on floor with boy, playing blocks)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17396

Human Generated Data

Title

Untitled (man on floor with boy, playing blocks)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Human 98.9
Person 98.9
Person 98.8
Baby 95.3
Shoe 75.1
Footwear 75.1
Clothing 75.1
Apparel 75.1
Floor 74.7
Flooring 68.6
Shorts 65.9
Finger 65.7
Portrait 61.1
Face 61.1
Photography 61.1
Photo 61.1
Room 60.6
Indoors 60.6
Crawling 58.8
Home Decor 58
Shoe 55.6

Imagga
created on 2022-02-26

sport 48.6
athlete 45.5
player 44.6
ball 43.3
world 30.9
man 29.6
silhouette 28.1
male 27.7
person 27.2
people 25.1
competition 24.7
team 22.4
training 21.2
field 18.4
match 18.3
exercise 18.2
black 18.1
fitness 18.1
football 17.3
active 16.7
kick 16.6
contestant 16.5
fun 16.5
play 16.4
goal 16.3
game 16.1
ballplayer 15.8
championship 15.6
soccer 15.4
recreation 15.2
equipment 14.8
stadium 14.6
adult 14.5
skill 14.4
skateboard 14.1
game equipment 14.1
lifestyle 13.7
muscular 13.4
action 13
racket 12.8
playing 12.8
tennis 12.7
court 12.7
wheeled vehicle 12.5
guy 12.4
event 12
sunset 11.7
run 11.6
crowd 11.5
outdoor 11.5
board 11.4
boy 11.3
soccer ball 11.3
body 11.2
men 11.2
shoot 10.8
leisure 10.8
audience 10.7
jump 10.6
runner 10.4
summer 10.3
motion 10.3
flag 10.1
park 9.9
cheering 9.8
cool 9.8
health 9.7
one 9.7
patriotic 9.6
nation 9.5
lights 9.3
dark 9.2
teenager 9.1
pose 9.1
vehicle 9
nighttime 8.8
pass 8.8
symbol 8.8
athletic 8.6
outside 8.6
youth 8.5
dancer 8.5
portrait 8.4
energy 8.4
teamwork 8.3
street 8.3
teen 8.3
style 8.2
icon 7.9
practice 7.7
dancing 7.7
sports equipment 7.6
clothing 7.6
casual 7.6
happy 7.5
human 7.5
sports 7.4
fit 7.4
group 7.3
looking 7.2
activity 7.2
grass 7.1
sky 7

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

clothing 90
person 89
text 86.5
toddler 84.6
black and white 82.9
baby 67.1
cartoon 64.2
drawing 58.3
boy 56.1

Face analysis

Amazon

Google

AWS Rekognition

Age 14-22
Gender Male, 86.1%
Calm 97.2%
Surprised 1.2%
Sad 0.5%
Angry 0.3%
Disgusted 0.3%
Happy 0.3%
Confused 0.1%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%
Shoe 75.1%

Captions

Microsoft

a man doing a trick on a skateboard 27.8%
a man is doing a trick on a skateboard 26.2%

Text analysis

Amazon

I34
KODVK8VEEIA

Google

3348
3348