Human Generated Data

Title

Untitled (four African American men and boy with pig in pen)
Date

1947
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2738

Human Generated Data

Title

Untitled (four African American men and boy with pig in pen)

People

Artist: Harry Annas, American 1897 - 1980

Date

1947

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-16

Person 99.7
Human 99.7
Person 99.4
Hog 99.3
Mammal 99.3
Animal 99.3
Person 99
Person 99
Person 97.5
Accessories 97.4
Tie 97.4
Accessory 97.4
Tie 85.2
Boar 83.5
Pig 77

Imagga
created on 2022-01-16

hog 100
swine 100
ungulate 78.1
farm 40.1
mammal 39.8
pig 34.7
animals 25.9
piggy 25
wild 23.5
wildlife 22.3
pork 22
piglet 21
pink 20.9
domestic 19.9
snout 18.7
cute 18.7
agriculture 17.5
grass 17.4
rural 15.9
pigs 15.8
livestock 15.1
farming 14.2
water 13.3
fur 13
dirty 12.7
meadow 12.5
nose 11.4
brown 11
pet 11
park 10.7
outdoor 10.7
fat 10.3
boar 10.1
field 10
mammals 9.7
sleeping 9.7
bull 9.7
funny 9.2
ocean 9.1
meat 9
zoo 8.7
safari 8.7
dangerous 8.6
food 8.5
head 8.4
adorable 8.3
close 8
mud 7.9
sleep 7.8
smell 7.7
ears 7.7
summer 7.7
dirt 7.6
bank 7.2
little 7.1

Google
created on 2022-01-16

Standing 86.4
Coat 86.4
Mammal 85.5
Style 83.8
Working animal 76.3
Monochrome photography 74
Suit 73.8
Suidae 73.1
Monochrome 71.5
Vintage clothing 69.7
Event 69.4
Domestic pig 68.6
Livestock 65.1
Room 64
History 62.5
Stock photography 62.2
Terrestrial animal 61
Classic 60.7
Bovine 55.6
Motor vehicle 52.4

Microsoft
created on 2022-01-16

outdoor 94.9
person 92.7
text 91.6
standing 90.2
animal 81.2
man 75.9
clothing 70.7
pig 54.8
posing 46.7

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 45-53
Gender Male, 99.8%
Calm 98.8%
Happy 0.5%
Surprised 0.2%
Disgusted 0.1%
Confused 0.1%
Angry 0.1%
Sad 0.1%
Fear 0%

AWS Rekognition

Age 9-17
Gender Female, 94.7%
Calm 95.9%
Sad 2%
Disgusted 0.5%
Surprised 0.5%
Angry 0.3%
Fear 0.3%
Confused 0.3%
Happy 0.3%

AWS Rekognition

Age 33-41
Gender Male, 95.6%
Calm 60.6%
Angry 15.1%
Disgusted 8.7%
Surprised 6.5%
Sad 3.6%
Confused 2.6%
Happy 1.9%
Fear 0.9%

AWS Rekognition

Age 24-34
Gender Male, 99.9%
Calm 50%
Confused 28.4%
Happy 16.4%
Sad 1.3%
Angry 1.2%
Surprised 1.1%
Disgusted 0.9%
Fear 0.8%

AWS Rekognition

Age 29-39
Gender Male, 99.4%
Sad 67.5%
Calm 26.6%
Confused 3.5%
Angry 1.1%
Disgusted 0.5%
Surprised 0.3%
Happy 0.2%
Fear 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Tie 97.4%
Pig 77%

Captions

Microsoft

a group of people standing in front of a building 74.9%
a group of people standing in front of a window 64.1%
a group of sheep standing on top of a building 53.7%

Text analysis

Amazon

EST

Google

KODVK- EEI
KODVK-
EEI