Human Generated Data

Title

Untitled (man with boy, playing baseball)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17298

Human Generated Data

Title

Untitled (man with boy, playing baseball)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17298

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 99.4
Human 99.4
Clothing 98.3
Apparel 98.3
Shoe 98.1
Footwear 98.1
Person 97.7
Tie 97
Accessories 97
Accessory 97
Shoe 94.6
Suit 90
Overcoat 90
Coat 90
Sunglasses 84.3
Shoe 77.1
Tarmac 68.6
Asphalt 68.6
Face 66.1
Female 64.3
Portrait 64.2
Photography 64.2
Photo 64.2
Finger 63.7
Jacket 59.9
Musician 58.9
Musical Instrument 58.9
Path 58.7
Leisure Activities 58.1
Plant 56.9
Sleeve 56
Long Sleeve 55.9
Tree 55.7
Pants 55.6

Clarifai
created on 2023-10-29

people 99.9
two 97.2
man 96.9
group together 96.6
adult 96.1
sports equipment 94.7
group 94.7
outfit 94.1
three 93.3
leader 93.2
administration 90.5
wear 88.9
actor 87.4
monochrome 86.5
four 85.5
child 85.3
woman 84.4
musician 83.5
several 83.4
golf club 82.8

Imagga
created on 2022-02-26

man 29
person 24.5
male 23.5
musical instrument 23.1
world 18
danger 17.3
wind instrument 16.8
people 16.7
destruction 16.6
mask 14.9
accordion 14.2
comedian 13.8
adult 13.7
nuclear 13.6
life 13.5
performer 13.5
disaster 12.7
protective 12.7
black 12.6
gas 12.5
silhouette 12.4
cricket bat 12.2
smoke 12.1
protection 11.8
radioactive 11.8
toxic 11.7
keyboard instrument 11.4
suit 11
dirty 10.8
sky 10.8
radiation 10.8
outdoor 10.7
cricket equipment 10.7
chemical 10.6
business 10.3
men 10.3
dark 10
stalker 9.9
human 9.7
businessman 9.7
military 9.7
device 9.6
boy 9.6
clothing 9.4
player 9.3
industrial 9.1
environment 9
soldier 8.8
entertainer 8.7
explosion 8.7
gun 8.7
sax 8.6
motion 8.6
walking 8.5
safety 8.3
sign 8.3
holding 8.3
sports equipment 8.2
music 8.1
symbol 8.1
success 8
brass 8
newspaper 8
building 7.9
standing 7.8
accident 7.8
statue 7.8
ballplayer 7.7
protect 7.7
active 7.4
against 7.4
sport 7.3
sunset 7.2
portrait 7.1
women 7.1
night 7.1
love 7.1
summer 7.1
work 7.1
day 7.1

Google
created on 2022-02-26

Trousers 96.1
Photograph 94.1
Tie 86.5
Black-and-white 85.3
Gesture 85.3
Style 84
Suit 80.5
Smile 79.5
Hat 76.8
Shorts 75.8
Monochrome photography 75.5
Happy 74.9
Monochrome 74.5
Snapshot 74.3
Formal wear 74.3
Vintage clothing 71.4
Boot 69.4
Classic 68
Event 67.3
Stock photography 65.3

Microsoft
created on 2022-02-26

clothing 94.5
text 92.9
person 90.8
outdoor 87.5
black and white 83.2
footwear 60.4
man 60.3
smile 59.6

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 28-38
Gender Male, 92.4%
Calm 55.8%
Angry 15.9%
Surprised 11.8%
Happy 6.3%
Disgusted 4.6%
Confused 2.1%
Sad 2.1%
Fear 1.4%

AWS Rekognition

Age 25-35
Gender Female, 57.1%
Calm 99.6%
Happy 0.1%
Sad 0.1%
Confused 0%
Fear 0%
Surprised 0%
Disgusted 0%
Angry 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Shoe
Tie
Sunglasses
Person 99.4%
Person 97.7%
Shoe 98.1%
Shoe 94.6%
Shoe 77.1%
Tie 97%
Sunglasses 84.3%

Categories

Imagga

paintings art 48.7%
interior objects 26.9%
streetview architecture 16.9%
pets animals 5.6%

Captions

Microsoft
created on 2022-02-26

an old photo of a person 64%

Text analysis

Google

A O
A
O