Human Generated Data

Title

Untitled (boy with pig in town square)

Date

1945

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2953

Human Generated Data

Title

Untitled (boy with pig in town square)

People

Artist: Harry Annas, American 1897 - 1980

Date

1945

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-21

Animal 99.5
Pig 99.5
Mammal 99.5
Person 99.3
Human 99.3
Person 99.2
Person 99.1
Person 98.8
Person 98.3
Person 97.5
Person 94.4
Person 91.4
Person 88.6
Person 87
Person 86.7
Bull 85.4
Person 75.6
Person 67.2
Hog 64.7
Person 62.7
Person 54.5

Imagga
created on 2022-01-21

swine 100
hog 100
ungulate 78
pig 47.3
piggy 41.4
farm 41
mammal 39.1
boar 29.4
pork 27.8
piglet 27.5
pink 25.1
animals 24.1
snout 22.6
wildlife 21.4
wild 20.9
livestock 19.8
cute 19.4
domestic 19
agriculture 17.6
rural 15.9
pigs 15.8
dirty 15.4
bank 15.2
grass 13.4
farming 13.3
fat 13.1
smell 12.6
funny 11.9
nose 11.4
finance 11
meat 10.8
dangerous 10.5
brown 10.3
fur 10.2
money 10.2
sow 9.9
mud 9.8
bull 9.7
ears 9.7
life 9.4
pet 9.2
meadow 9
financial 8.9
even-toed ungulate 8.9
piggy bank 8.8
water 8.7
tail 8.6
save 8.5
food 8.5
baby 8.4
savings 8.4
field 8.4
banking 8.3
little 7.9
hair 7.9
feeding 7.8
fighting 7.8
zoo 7.7
pasture 7.7
outdoor 7.6
horse 7.6
horizontal 7.5
park 7.4
adorable 7.4
investment 7.3
business 7.3
black 7.2

Google
created on 2022-01-21

Microsoft
created on 2022-01-21

fish 97.1
text 97
animal 93.6
black and white 92.3
marine mammal 88
black 71.1
white 65.9
shark 55.6

Face analysis

Amazon

Google

AWS Rekognition

Age 18-24
Gender Female, 50.2%
Calm 95.4%
Fear 1.6%
Surprised 1.1%
Sad 0.7%
Disgusted 0.5%
Happy 0.3%
Angry 0.3%
Confused 0.2%

AWS Rekognition

Age 48-56
Gender Male, 99.2%
Calm 88.9%
Sad 8.2%
Happy 1%
Surprised 0.9%
Confused 0.4%
Angry 0.3%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 27-37
Gender Male, 97.7%
Happy 69.2%
Calm 24.6%
Angry 2.4%
Sad 1.9%
Fear 0.8%
Surprised 0.5%
Confused 0.3%
Disgusted 0.3%

AWS Rekognition

Age 16-22
Gender Female, 62.8%
Angry 48.5%
Calm 26.4%
Sad 12.3%
Surprised 7%
Fear 2%
Happy 1.8%
Confused 1.1%
Disgusted 0.9%

AWS Rekognition

Age 16-24
Gender Female, 94%
Calm 62.1%
Fear 17.8%
Sad 5.9%
Happy 5.1%
Angry 2.9%
Surprised 2.5%
Confused 2.1%
Disgusted 1.5%

AWS Rekognition

Age 21-29
Gender Female, 61.1%
Fear 91.6%
Happy 6.1%
Surprised 1%
Calm 0.5%
Angry 0.4%
Sad 0.2%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 13-21
Gender Female, 77.3%
Calm 67.8%
Sad 12.7%
Fear 7.8%
Disgusted 4.7%
Happy 2.3%
Angry 2.2%
Confused 1.3%
Surprised 1.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Pig 99.5%
Person 99.3%

Captions

Microsoft

a cow is standing in front of a crowd 87.2%
a man standing in front of a crowd 77%
a man standing in front of a crowd of people watching a cow 76.9%

Text analysis

Amazon

KODAK-SVEELA