Human Generated Data

Title

The Family of a Migratory Fruit Worker from Tennessee

Date

1937

People

Artist: Arthur Rothstein, American 1915 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.1417

Human Generated Data

Title

The Family of a Migratory Fruit Worker from Tennessee

People

Artist: Arthur Rothstein, American 1915 - 1985

Date

1937

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.1417

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.7
Human 99.7
Person 99.2
Person 98.7
Person 98.3
Person 98.2
Person 98
Bus 86
Transportation 86
Vehicle 86
People 83
Face 75.4
Mirror 65.8
Portrait 58.8
Photography 58.8
Photo 58.8
Girl 55.7
Female 55.7

Clarifai
created on 2023-10-26

people 100
child 99.5
vehicle 99.5
transportation system 99.2
two 99.1
adult 99.1
group 99.1
offspring 99
car 98.9
man 98.6
portrait 98.2
three 97.9
driver 97.9
woman 96.1
vehicle window 96.1
sibling 94.6
four 93.6
family 92.6
group together 92.5
convertible 91.8

Imagga
created on 2022-01-23

car 82.1
vehicle 59.4
passenger 54.1
automobile 45.9
transportation 43.9
auto 40.2
driver 38.8
drive 35.9
toaster 32.1
transport 31
driving 30
kitchen appliance 29
sitting 25.8
travel 25.3
minibus 24.2
happy 23.2
person 22.9
bus 22.4
smile 22.1
adult 22
home appliance 21.8
road 19.9
wheel 19.8
people 19.5
portrait 18.1
new 17.8
man 16.8
smiling 16.6
happiness 16.4
public transport 15.6
inside 15.6
television 15.4
outdoors 14.9
male 14.9
appliance 14.8
window 14.7
cheerful 14.6
pretty 14
speed 13.7
joy 13.4
attractive 12.6
fashion 12.1
summer 11.6
traffic 11.4
fun 11.2
looking 11.2
windshield 10.7
motor 10.6
motor vehicle 10.6
couple 10.5
black 10.2
casual 10.2
one 9.7
hair 9.5
luxury 9.4
side 9.4
door 9.2
headlight 9.2
modern 9.1
conveyance 9.1
cute 8.6
youth 8.5
trip 8.5
hand 8.4
20s 8.2
family 8
business 7.9
love 7.9
face 7.8
outdoor 7.6
camera 7.5
human 7.5
mirror 7.5
fast 7.5
screen 7.3
durables 7.3
seat 7.3
truck 7.2
telecommunication system 7.2

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

bus 95.8
person 94.4
human face 93.7
window 88.7
black and white 83.1
transport 74.6
clothing 72.2
vehicle 65.1
man 61.5
old 44.3
image 38.6
picture frame 11.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 28-38
Gender Male, 99.9%
Calm 97.1%
Sad 1.6%
Confused 0.5%
Angry 0.4%
Disgusted 0.1%
Happy 0.1%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 4-12
Gender Female, 99.6%
Sad 57.5%
Angry 26.6%
Confused 11.6%
Calm 1.6%
Fear 0.9%
Disgusted 0.7%
Surprised 0.6%
Happy 0.4%

AWS Rekognition

Age 4-10
Gender Female, 99.1%
Sad 96.1%
Angry 2%
Disgusted 1.1%
Calm 0.4%
Fear 0.2%
Happy 0.1%
Surprised 0.1%
Confused 0%

AWS Rekognition

Age 6-14
Gender Female, 99.9%
Sad 94.9%
Calm 4.1%
Happy 0.4%
Fear 0.2%
Angry 0.2%
Disgusted 0.1%
Confused 0.1%
Surprised 0%

AWS Rekognition

Age 12-20
Gender Female, 95.8%
Sad 36%
Calm 25.6%
Confused 17.7%
Angry 11%
Disgusted 6.7%
Surprised 1.4%
Fear 1%
Happy 0.6%

AWS Rekognition

Age 6-12
Gender Female, 98.4%
Fear 98.1%
Calm 1.3%
Sad 0.3%
Surprised 0.2%
Angry 0.1%
Disgusted 0%
Confused 0%
Happy 0%

Microsoft Cognitive Services

Age 4
Gender Female

Microsoft Cognitive Services

Age 32
Gender Female

Microsoft Cognitive Services

Age 9
Gender Female

Microsoft Cognitive Services

Age 4
Gender Male

Microsoft Cognitive Services

Age 23
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Bus 86%