Human Generated Data

Title

Untitled (wheat harvest, central Ohio)
Date

August 1938, printed later
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3301
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (wheat harvest, central Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

August 1938, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3301

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Photography 100
Face 100
Head 100
Portrait 100
Clothing 100
Shorts 100
T-Shirt 99.7
Person 99.6
Boy 99.6
Child 99.6
Male 99.6
Person 99.2
Baseball 98.5
Baseball Glove 98.5
Glove 98.5
Sport 98.5
Back 92.5
Body Part 92.5
Window 84.8
Person 83.3
Hat 74.9
Brush 71.7
Device 71.7
Tool 71.7
Baseball Bat 69
Bathing 66.8
Architecture 58
Building 58
Outdoors 58
Shelter 58
Swimwear 57.5
Neck 57.4
Art 56.8
Home Decor 56.5
Housing 56.2
Wall 56.1
Painting 56
Washing 55.7
Siding 55.7
Baseball Cap 55.7
Cap 55.7
Brick 55.6
Finger 55.3
Hand 55.3

Clarifai
created on 2018-05-10

people 99.3
adult 97.9
woman 96.5
man 95.7
window 94.1
one 93.2
portrait 91.8
desktop 90.9
child 90.4
young 89.1
girl 87.5
person 84.6
glance 83.9
business 83.6
beautiful 81
wall 80.7
office 80.5
boy 80.1
love 78.2
pretty 77.5

Imagga
created on 2023-10-05

window shade 63.1
window blind 50.5
blind 40.6
protective covering 37.8
person 25.2
adult 23.4
covering 22.5
man 20.8
people 20.6
window screen 20.6
portrait 19.4
happy 18.2
smiling 18.1
male 18
screen 16.5
lifestyle 15.9
building 14
cheerful 13.8
smile 13.5
business 13.4
window 13.2
sitting 12.9
child 12.9
outdoors 12.7
world 12.7
attractive 12.6
happiness 12.5
pretty 11.9
urban 11.4
standing 11.3
human 11.2
one 11.2
youth 11.1
love 11
model 10.9
cute 10.8
office 10.7
face 10.7
look 10.5
couple 10.5
city 10
holding 9.9
modern 9.8
fashion 9.8
fun 9.7
looking 9.6
home 9.6
corporate 9.4
door 9.4
casual 9.3
windowsill 9.2
relaxation 9.2
job 8.8
businessman 8.8
indoors 8.8
women 8.7
joy 8.3
executive 8.3
alone 8.2
indoor 8.2
body 8
sill 7.9
black 7.9
day 7.8
brunette 7.8
boy 7.8
professional 7.8
architecture 7.8
men 7.7
outdoor 7.6
one person 7.5
girls 7.3
businesswoman 7.3
hair 7.1
family 7.1
posing 7.1
kid 7.1

Google
created on 2018-05-10

photograph 96.2
black 95
black and white 93.6
monochrome photography 85.7
standing 85.5
sitting 85.5
photography 84.6
snapshot 81.8
monochrome 70.3
window 68.2
picture frame 68.1
child 67.8
girl 66.8
human behavior 60.2
angle 55.1
stock photography 51.3

Microsoft
created on 2018-05-10

window 99.9
outdoor 88.1
white 61.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-16
Gender Male, 98.4%
Disgusted 98.9%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Confused 0.2%
Angry 0.2%
Calm 0.1%
Happy 0%

AWS Rekognition

Age 26-36
Gender Female, 99.8%
Sad 95%
Happy 33.5%
Surprised 9%
Calm 6.8%
Fear 6.2%
Confused 4.4%
Angry 1.8%
Disgusted 1%

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 46
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Boy 99.6%
Child 99.6%
Male 99.6%
Baseball Bat 69%

Categories

Imagga

paintings art 72.9%
streetview architecture 14.2%
text visuals 10.2%
nature landscape 1.4%